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CHAPTER  1 


INTRODUCTION 


I. 00  Introduction : 

W boro  do  I  begin?  ...Every  Decision  Support  System 
(DSS)  designer/builder  must  ask  himself  this  question 
every  time  he  sets  out  to  build  a  support  system. 

This  hesitation  at  the  start  of  a  problem  is  not 
uncommon .  All  humans  have  experienced  this  dilemma 
when  they  are  faced  with  a  complex  decision.  Think 
about  the  last  time  one  of  your  home  appliances  broke 
down.  How  did  you  go  about  getting  it  fixed?  How  did 
you  go  about  finishing  the  task  that  was  started  when 
the  machine  failed?  Do  you  remember  ail  the  steps  you 
took?  What  were  all  of  the  alternatives?  What  was 
the  first  thing  you  did?  If  it  happened  right  now  what 
would  be  the  first  thing  to  do?  If  you're  like  most 
people,  these  questions  are  hard  to  answer  and  bring 
back  strong  emotions  like  frustration,  hopelessness, 
or  fear.  And  yet,  these  are  relatively  simple  problems; 
problems  that  have  been  solved  before  by  you  or  others. 

Although  the  DSS  designer  is  not  faced  with  the 
same  problems  or  emotions,  he  is  faced  with  the  same 
questions.  Where  is  the  starting  point?  What  are  the 
key  points  of  the  problem?  This  dilemma  stems  from 
the  lack  of  two  important  aspects  of  the  problem.  Every 


decision  maker  must  have  1)  a  clear  definition  of  the 


problem  and  2)  an  understanding  of  the  decision  making 
process  used  to  solve  the  problem. 

This  thesis  effort  is  an  attempt  to  help  the  DSS 
designer/  builder  in  his  task  of  finding  the  starting 
point.  This  paper  introduces  a  method  for  defining 
problems  and  identifying  the  decision  process.  The 
results  of  this  method  aid  the  designer/  builder  in 
the  construction  of  a  OSS  by  pointing  out  the  key  points 
or  kernels  of  the  problem  where  a  OSS  can  assist  a  decision 
process . 

1.10  Background: 

How  the  human  mind  works  is  an  extremely  interesting 
topic  that  eludes  complete  understanding.  Somehow  the 
human  mind  takes  new  information  and  stores  it.  Later, 
when  faced  with  a  task  that  needs  the  information,  the 
mind  recalls  it  and  performs  various  operations  on 
it.  These  operations  are  known  as  cognitive  processes. 
These  cognitive  processes  are  used  to  accomplish  tasks 
such  as  problem  solving  and  decision  making. 

There  are  times  when  a  decision  maker  is  faced 
with  complex  or  very  difficult  decisions.  These  decisions 
require  vast  amounts  of  data,  very  complex  cognitive 
processes,  or  intricate  sequencing  of  cognitive  processe- 
s.  Under  these  conditions,  the  decision  maker  requires 


some  sort  of  help.  This  help  in  making  decisions  comes 
in  the  form  of  a  decision  support  system. 

The  DSS  provides  support  for  a  particular  cognitive 
process  when  faced  with  a  specific  decision  or  problem. 

A  DSS  is  *a  system,  manual  or  automated,  that  aids  a 
decision  maker  in  the  cognitive  processes  of  judgement 
and  choice*  (Valusek,  1986).  To  build  a  DSS,  the  cognitive 
processes  that  make  up  the  decision  or  problem  solving' 
process  must  be  identified.  This  identification  process 
or  search  is  otherwise  known  as  defining  or  describing 
the  problem. 

Problem  definition  requires  the  identification 
of  the  solution  process  as  an  integral  part  of  the  DSS 
design.  This  topic  is  crucial  to  the  continued  developin' 
ent  of  DSS  as  a  viable  means  to  help  decision  makers 
with  complex  tasks.  Without  a  clear  understanding  of 
the  problem  and  how  the  decision  process  works,  the 
DSS  builder  is  just  randomly  producing  aids  that  may 
or  may  not  be  effective  support  for  the  decision  maker. 

Decision  aids  are  too  time  consuming  and  expensive 
to  be  built  in  a  haphazard  manner.  A  process  is  needed 
to  identify  the  key  steps  in  the  decision  process ,  and 
suggest  to  the  designer  which  elements  of  the  problem 
will  benefit  the  decision  maker  most.  Its  result  would 
be  a  list  of  decision  making  elements  that,  if  necessary, 
can  be  ranked  in  order  of  most  to  least  supportive. 


Each  item  on  the  list  of  decision  making  elements  is 
a  potential  kernel.  A  karnal  ia  a-  kay  decision  alamant 
in  a  decision  or  problem  solving  process  which  is  a  . 
feasible  starting  point  from  which  to  build  a  DSS. 

Once  the  designer  has  the  list,  he  can  construct 
decision  aids  that  are  based  on  the  cognitive  process 
and  effectively  support  the  decision  maker.  Using  this 
approach,  the  decision  maker  receives  the  most  effective 
support  that  is  technologically  available  in  minimum 
time  and  at  least  cost.  This  is  a  very  appealing  idea, 
but  how  does  a  designer  go  about  finding  these  decision 
elements?  Is  there  an  existing  procedure  to  follow? 

1.11  Formal  Training  in  Decision  MakinK: 

When  decision  makers  are  formally  taught  how  to 
make  decisions,  they  are  taught  two  things:  1)  Every 
problem  can  be  approached  systematically,  and  2)  There 
are  a  variety  of  problem  solution  techniques  that  can 
be  applied  given  the  right  problem.  The  thing  they 
are  not  taught  is  the  skill  to  identify  and  define  the 
problem.  The  lack  of  formal  training  in  descriptive 
decision  processes  is  a  detriment  to  decision  makers 
(Keen,  1978:02;  Leavitt,  1970).  Both  authors  agree 
that  too  little  emphasis  is  placed  on  problem  finding 
as  opposed  to  problem  solving.  Consequently ,  the  decision 
makers  see  decision  making  as  a  structured  task  and 


concern  themselves  only  with  the  content  of  the  decision, 
end  the  enelyticel  methods  used  (Xeen,  1978:62).  Browsing 
through  any  Academic  course  cetelog  thet  lists  decision 
making  courses  supports  this  observation.  Figure  1-1 
is  a  sampling  of  a  course  listing  from  the  AF1T  catalog 
1985-1987. 

Omitting  problem  identification  and  definition 
skills  from  academic  curriculum  is  not  the  complete 
fault  of  acadeiaic  institutions  nor  instructors.  Besearch 
into  how  humans  make  decisions  has  not  kept  pace  with 
our  need  to  understand  the  decision  process.  Stabell 
identifies  the  need  for  more  research  into  decision 
processes  so  DSS  development  could  go  forward.  His 
call  is  for  more  research  into  the  specific  methodologies 
for  describing  the  decision  processes  and  identifying 
criteria  for  improving  them  (Stabell,  1975). 

Without  being  trained  in  problem  description  techniques, 
our  decision  makers  go  into  a  world  full  of  complex, 
inter-  twined  problems.  They  do  not  have  any  tools 
readily  available  that  can  give  a  descriptive  understanding 
of  the  problem.  Thus,  until  they  develop  a  sixth  sense 
on  their  own,  they  have  a  difficult  time  answering  the 
starting  questions.  This  fact  is  clearly  evident  to 
DSS  designers. 


OPER  526  -Quantitathe  DkWn  Making. 

Credits  4 
Prerequisites:  None. 

This  »  an  introductory-level  course  in 
operations  research  techniques.  Emphasis  in 
the  course  is  directed  toward  understanding 
and  application  of  the  techniques  to 
managerial  problem  solving  and  decision  mak¬ 
ing  rather  than  toward  theorem  derivations  or 
proofs.  Major  topics  covered  include  linear 
programming,  inventory  theory,  queueing 
theory,  and  decision  theory. 

Text-  An  Introduction  to  Management  Sci¬ 
ence.  by.  Anderson.  Sweeney  and 

Williams. 


OPES  563 


Credits:  4 


Extea- 


Prerequisites:  None. 

This  is  the  initial  course  in  the  opera¬ 
tions  research  sequence.  The  course  begins 
with  a  discussion  of  the  role  of  quantification 
and  modeling  in  decision  making  and  resource 
management  and  an  overview  of  Air  Force 
quantitative  analysis  applications.  The  primary 
types  of  operations  research  models  covered 
in  this  first  course  are  deterministic  mathemat¬ 
ical  programming  models,  like  linear  program¬ 
ming.  the  transportation  model,  and  game 
theory.  The  strengths  and  weaknesses  of 
these  operations  research  models  are 
presented  and  discussed  in  the  context  of 
military  applications. 


OPER  742  -Analysis  for  Defease  Decision*. 

Credits:  3 

Prerequisites:  None. 

This  course  discusses  the  role  of  analysis 
in  defense  decisions  and  examines  both  the 
limitations  and  capabilities  of  analysis  in  the 
decision-making  process.  The  distinctive 
features  of  this  course  are  its  broad  coverage 
of  analytic  aids  to  decision-making  and  its 
focus  on  the  needs  of  the  user.  Specific  topics 
include:  the  need  for  analysis  in  public  sector 
decisions,  the  basic  framework  for  analysis, 
quantitative  and  qualitative  methods, 
acceptance,  implementation,  and  pitfalls  and 
limitations  of  analysis. 


OPER  760  -  Operations  Research  IL 

Credits:  3 

Prerequisites:  OPER  660.  MATH  592, 

MATH  692 

This  is  the  second  of  a  two  course 
sequence  introducing  operations  research  to 
management  students.  The  two  courses 
survey  operations  research  models  and 
methodologies  and  examine  the  role  of  opera¬ 
tions  research  in  managerial  decision  making. 
This  second  course  emphasizes  probabilistic 
models  and  covers  the  topics  of  inventory 
models,  queueing  models,  a  brief  look  at  simu¬ 
lation.  Markov  processes,  and  reliability 
models.  Examples  and  cases  from  the  USAF 
environment  are  emphasized. 

Text:  Principles  of  Operations  Research  for 
Management,  by  Budnick  et  at. 


Figure  1*-1.  Courses  frota  AFIT  Catalog  1985-87 
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1.12  Descriptive  Technicu es: 

There  are  several  ways  to  describe  problems.  Two 
of  tbs  most  common  are  word  description  and  visual  images. 
Both  have  advantages  and  disadvantages  in  performing 
the  descriptive  role  for  problem  definition.  But  are 
these  the  best  for  problem  description? 

Using  word  descriptions  is  a  lengthy,  time  consuming 
and  sometimes  confusing  exercise.  The  decision  maker 
must  fully  describe  each  detail  of  the  problem  so  another 
person  can  receive  the  correct  meaning.  If  the  problem 
is  at  all  complex,  the  description  may  become  very  lengthy 
and  cumbersome.  The  comprehension  of  the  problem  relys 
heavily  on  the  ability  of  the  author  to  use  the  language 
and  organize  the  facts  in  the  description.  Also  the 
presentation  of  the  information  is  forced  into  a  linear 
form  which  is  not  always  conducive  to  effective  learning. 
However,  the  method  is  excellent  in  recording  the  smallest 
details  and  relationships  of  problem  elements. 

Visual  images  include  pictures,  diagrams,  charts, 
blue-  prints,  etc.  These  are  tools  that  depict  a  problem 
in  a  concrete  manner  using  lines,  curves  and  shapes 
to  represent  the  elements  of  the  problem.  An  image 
is  universally  understood  and  therefore  overcomes  some 
of  the  language  barriers  inherent  in  word  descr iptions . 
Images  are  one  way  to  enhance  the  learning  process  by 


aiding  the  ability  of  the  learner  to  recall.  However, 


images  cannot  provids  the  intricate  detail  needed  for 
relating  complete  understanding  of  all  the  details  in 
a  problem. 

There  is  another  method  developed  by  educational 
psychologists  that  may  offer  some  ability  to  enhance 
the  advantages  of  both  descriptive  techniques.  Concept 
mapping  is  a  combination  of  both  word  description  and 
visual  images.  It  is  designed  to  represent  concepts 
as  they  are  understood  by  the  mind.  This  capability 
gives  two  main  advantages.  First,  the  mind  can  more 
easily  learn  from  the  map.  Learning  is  enhanced  because 
the  map  is  a  visual  representation  of  the  concepts  and 
their  links  to  each  other.  The  map  shows  the  links 
in  the  same  manner  as  the  mind  links  and  stores  the 
concepts  in  memory.  Second,  there  is  no  restriction 
on  the  organization  of  the  map.  Information  is  not 
locked  into  a  linear  presentation . # 

1.13  The  Importance  of  Describing  Problems: 

When  a  decision  maker  realizes  he  cannot  handle 
a  complex  problem  as  effectively  as  simpler  problems, 
he  calls  for  decision  support.  In  the  past,  decision 
support  might  have  been  a  ledger  book,  a  wall  chart, 
or  drawings.  Today  the  realm  of  decision  aids  extends 
into  the  high-tech  world  of  computers,  simulation,  and 
artificial  intelligence  (AI) .  But  the  underlying  dilemma 


j 


still  facts  the  designer.  What  is  the  problem?  What 
are  the  decision  processes  that  should  be  helped  by 
a  decision  aid?  The  only  way  to  answer  these  questions 
is  to  describe  the  problem.  A  descriptive  process  is 
needed . 

Why  is  the  descriptive  process  of  decision  making 
so  important?  Keen  and  Scott-Morton  explain  it  best 
when  they  say:  ‘Decision  support  requires  a  detailed 
understanding  of  decision  making  in  organizations. 

A  descriptive  fraswwork  provides  the  basis  for  prescript¬ 
ive  design;  that  is,  to  'improve'  a  decision  process, 
one  must  first  define  and  analyze  it*  (Keen,  1978:01) . 

As  a  means  to  aid  the  designer/decision  maker  in 
his  understanding  of  the  problem  space  and  description 
of  the  decision  process ,  this  project  became  one  of 
identifying  a  descriptive  process  that  supports  the 
identification  of  key  decision  elements  or  kernels, 
so  that  the  designer  produces  a  pertinent  and  effective 
decision  support  system  (DSS)-t 


l . 20  The  Problem: 

.'f  '  -  y 

C  v 

"How-doer  a  DSS  designer  identify  the  kernel (s)^ 
of  a  problem,  from  the  user’s  perspective,  and  develop 
a  design  for  a  DSS  from  them?  The  problem  arises  because 
DSS  adaptive  design  says  ‘start  small  and  grow* ,  but 
there  are  no  suggestions  on  where  to  start. 
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1.21  Tha  Challanga: 

Can  concept  mapping  techniques  ba  davalopad  into 
a  usar  oriantad  tool  to  halp  idantify  karnala? 


1.30  Scopa : 

,  Thia  thaaia  add raaaaa  tha  primary  challanga  by 
davaloping  tha  tool,  concapt  mapping,  aa  a  maana  to 
idantify  karnala  in  a  daciaion  procaaa.  Thia  ia  a 
daacriptiva  procaaa  that  dafinaa  tha  problam  apaca, 
daacribaa  tha  daciaion  procaaa,  and  idantifiaa  tha  kay 
atapa  of  tha  daciaion  procaaa  aa  potantial  karnala. 

Bayond  thia  initial  challanga  ia  tha  challanga  of  intagrating 
concapt  mapping  into  tha  adaptiva  daaign  procaaa. 

Thia  thaaia  affort  will  taka  tha  tachniqua  of  concapt 
mapping  and  uaa  it  to  axtract  tha  information  about 
a  problam  from  tha  daciaion  makar  himaalf.  Tha  raault 
of  thia  axtraction  ahould  ba  a  wall  dafinad  problam 
apaca,  a  aufficiantly  daacribad  daciaion  procaaa  and 
a  maana  to  idantify  tha  karnala.  Finally,  tha  affort 
turna  to  intagrating  concapt  mapping  into  tha  adaptiva 
daaign  procaaa.  Tha  intagration  of  concapt  mapping 
into  tha  adaptiva  daaign  procaaa  ia  accompliahad  through 
a  procaaa  callad  tha  problam  dafinition  procaaa  (PDP) .  .  : _ — - 


A a  a  maana  of  davalopmant  of  tha  concapt  mapping 
tachniqua  and  axpar imantation  with  tha  PDP,  aavaral 


teat  cuts  of  varioua  DSSa  war*  attempted.  A  f aw  of 
thaaa  teat  casta  art  reported  latar  in  chaptars  5  and 
0  of  thia  papar. 

Bacauaa  tha  acopa  of  thia  pro j act  ia  to  find  a 
way  to  idantify  karnala,  thara  ara  aavaral  aaaociatad 
araaa  idantifiad  that  wara  not  inveatigated .  Thaaa 
araaa  may  ba  tha  baaia  for  furthar  raaaarch  but  ara 
bayond  tha  acopa  of  thia  project. 

Tha  firat  of  thaaa  araaa  haa  to  do  with  individual 
parcaptiona.  Sinca  diffarant  people  have  different 
parcaptiona  of  problama  and  how  to  approach  them,  they 
will  have  different  detaila  in  their  daciaion  proceaa. 
Therefore,  no  attempt  will  ba  made  to  determine  tha 
'beat  or  optimal’  daciaion  proceaa.  Only  the  ’accepted 
or  agreed*  deciaion  proceaa  will  ba  found  uaing  tha 
concept  mapping  technique.  Much  more  raaaarch  into 
tha  baaic  underatanding  of  cognitive  procaaaing  of  the 
human  mind  naada  to  be  dona  before  evaluationa  of  the 
ef f activanaaa  of  proceaaaa  can  ba  accompl iahed . 

Purauing  thia  idea  of  cognitive  optimization,  no 
auggaationa  nor  recommendationa  will  ba  offered  to  the 
expert  about  changing  hia  cognitive  procedure8  to  optimize 
hia/har  proceaa.  Tha  expert  ia  juat  that;  an  expert. 

S/he  haa  far  more  experience  working  hia/her  problem 
than  tha  analyat/daaignar .  Therefore,  any  auggaationa 
made  would  ba  baaed  on  total  auppoaition  aince  no  actual 


studies  have  come  forth  explicitly  showing  one  cognitive 
procedure  as  more  effective  than  another. 

A  third  topic  not  addressed  by  this  effort  is  the 
automation  of  the  concept  mapping  technique.  There 
are  several  places  where  automation  may  be  helpful  to 
the  researcher  while  actually  producing  the  concept 
maps,  but  that  is  beyond  the  purpose  of  this  effort. 

1.40  Hypotheses : 

This  thesis  was  designed  around  two  basic  hypotheses 
that  are  supported  by  several  beliefs.  Following  are 
the  hypotheses  and  the  beliefs.  By  showing  each  of 
these  beliefs  to  be  true,  the  hypothesis  is  then  assumed 
to  be  valid. 


1.41  The  First  Basic  Hypothesis: 

Concept  Mapping  can,  in  sufficient  detail,  represent 
an  individual’s  understanding  of  a  problem  and  his  de¬ 
scription  of  the  decision  process  in  order  to  identify 
kernels  for  the  design  of  a  decision  support  system. 

A.  Multiple  concept  maps,  created  on  the  same  problem, 
will  have  similar  main  concepts  and  key  areas.  This 
similarity  should  be  seen  between  earlier  and  later 
maps  of  the  same  person  and  also  among  maps  of  different 
people . 
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B.  On*  or  mort  of  the  main  concepts  (key  decision 
elements)  will  be  easily  identified  whan  comparing  multiple 
concept  maps  of  the  decision  process.  These  main  concepts 
will  be  the  kernels. 

C.  As  expert’s  perceptions  change  over  time,  unimpor¬ 
tant  issues  will  drop  from  the  problem  space.  Thus, 

the  key  decision  elements  in  a  problem  will  repeat  and 
be  identified  when  compared  with  previous  maps. 

D.  Concept  maps  are  simpler  to  read  because  they 
present  the  information  in  the  same  manner  that  man 
stores  information  in  his  mind.  This  concept  makes 

it  easier  for  others  to  achieve  the  same  understanding 
as  the  expert  who  originated  the  map. 

E.  No  two  people  will  construct  identical  maps  on 
the  same  problem  apace,  nor  will  the  same  person  repeat 
identical  maps  after  a  significant  period  of  time. 

But,  identical  key  decision  elements  from  the  decision 
process  will  be  repeated.  This  will  lead  the  designer 
to  give  more  credence  to  those  elements  as  kernels  than 


others . 


An  explicit  problem  definition,  which  includes 
a  thorough  definition  of  the  problem  space  and  a  complete 
detailed  description  of  the  decision  process  involved 
in  the  solution  of  the  problem,  is  essential  to  the 
effective  design  process  of  decision  support  systems. 

A.  Kernels  can  be  identified  only  after  the  designer 
has  explicitly  defined  the  problem. 

B.  All  problems  contain  elements  of  a  decision  process 
that  traverse  the  entire  spectrum  of  *  structuredness ' . 

This  means  that  some  steps  are  highly  structured  while 
others  are  not.  (Xeen  and  Scott-Morton)  (Simon) 

1.30  General  Approach: 

To  meet  the  challenges,  this  thesis  divides  into 
several  goals  which  outline  the  approach  taken  to  solve 
the  problem  of  kernel  identification.  The  first  goal 
is  to  develop  a  tool  for  relaying  understanding  between 
individuals.  With  a  tool  of  this  nature,  a  DSS  designer 
could  extract  an  expert’s  understanding  of  the  problem 
and  how  he  goes  about  solving  it.  The  tool  selected 
in  this  project  is  a  technique  from  the  field  of  educa¬ 
tion  called  Concept  Mapping.  Concept  Mapping  has  been 
shown  to  be  an  effective  teaching  tool  for  relating 


new  concepts  and  their  meanings  to  students.  By  slightly 
altering  the  process  used  by  education,  the  concepts 
and  meanings  about  a  problem  can  be  extracted  from  an 
expert  by  the  designer.  With  this  technique  an  expert's 
understanding  of  a  problem  and  his  description  of  the 
decision  process  can  be  captured.  See  chapters  3  and 
4  for  further  discussion  and  explanation. 

The  second  goal  was  to  develop  the  method  of  explicit 
problem  definition.  That  is  to  say,  what  are  the  steps 
in  extracting  the  information  from  the  expert?  Fully 
describing  or  understanding  the  problem  requires  two 
distinct  steps.  The  first  step  is  to  clearly  and  concisely 
define  the  problem  space  based  on  the  user's  perception. 
Once  the  problem  is  defined,  the  second  step  is  to  identify 
the  key  elements  from  the  user’s  description  of  the 
decision  process .  Include  all  the  key  decision  steps 
that  are  identified  as  potential  kernels. 

Once  the  problem  is  described  or  explicitly  defined, 
the  designer  can  then  complete  the  challenge  of  this 
thesis  and  identify  the  kernel (s) .  Therefore,  the  third 
goal  was  to  show  that  the  concept  mapping  of  the  problem 
definition  and  decision  process  does  help  identify  the 
kernels  of  the  problem. 

The  fourth  goal  was  to  recommend  to  the  DSS  designer 
how  he  can  incorporate  the  steps  and  tools  above  into 
the  adaptive  design  process.  Adaptive  design  is  a  process 


that  aids  a  designer  in  explicitly  defining  a  DSS.  In 
other  words,  adaptive  design  finds  a  simple  method  or 
procedure  that  a  DSS  designer  can  use  to  describe  the 
problem  and  design  the  system.  Chapter  5  explains  in 
detail  the  PDP  that  is  proposed. 

As  a  means  to  complete  the  goals  above  and  verify 
the  hypotheses,  two  types  of  test  cases  were  used. 

Since  the  main  emphasis  of  the  effort  was  to  identify 
the  kernels  for  the  design  of  a  DSS,  the  majority  of 
the  applications  of  concept  mapping  were  on  DSS  projects 
for  classes  and  thesis  requirements.  To  test  the  applic 
ability  of  concept  mapping  in  a  larger  problem  domain, 
a  second  type  of  test  case  was  chosen.  Concept  mapping 
was  applied  to  the  definition  and  decision  process  of 
Rapid  Application  of  Air  Power  (RAAP) . 

1.00  Sequence  of  Presentation: 

Each  of  the  remaining  chapters  were  designed  to 
present  the  findings,  procedures  and  accomplishments 
of  this  thesis  effort. 

Chapter  2  explores  the  decision  maker’s  world. 

It  explains  the  reason  a  decision  maker  needs  the  skill 
of  a  descriptive  process  as  the  main  goal  of  the  chapter 


Chapter  3  lays  the  ground  work  of  theory  behind 
concept  mapping.  It  introduces  the  current  theories 
of  storing  knowledge  in  the  human  mind  and  introduces 


Ausubel’s  theories  o f  educating. 

Chapter  4  describee  the  concept  mapping  tool. 

It  explains  what  it  is  and  how  you  can  use  it.  A  lesson  ' 
plan  is  presented  that  will  teach  the  reader  how  to 
use  concept  mapping. 

Chapter  5  explains  the  proposed  PDP.  Although 
each  step  is  explained,  the  main  emphasis  is  on  the 
role  concept  mapping  plays  in  the  process. 

Chapter  0  documents  the  seven  DSS  projects  where 
concept  mapping  was  used.  There  are  several  examples 
of  maps  and  kernels  that  were  found  by  the  designers. 

Some  comments  by  the  DSS  designers  about  concept  mapping 
and  the  process  are  listed. 

Chapter  7  documents  the  use  of  concept  mapping 
on  RAAP .  A  very  large  unstructured  problem  was  mapped 
using  several  experts.  Concept  maps  are  shown  which 
depict  the  expert's  understanding  of  the  concept  of 
Rapid  Application  of  Air  Power.  The  results  of  the 
mapping  and  the  final  recommendations  show  that  concept 
mapping  can  be  useful  in  very  large  problem  spaces  as 
a  tool  for  planning  and  designing  large  systems. 

Finally  chapter  8  concludes  the  paper  with  a  summary 
of  findings  about  the  concept  mapping  technique  as  well 
as  the  summary  of  results  from  the  problem  definition 
experiments.  Recommendations  for  future  research  and 
the  conclusion  are  included. 


Chapter  2 

The  World  of  the  Decision  Maker 

2 . 00  Introduction : 

This  chapter  focuses  on  the  abstract  problem  solving 
world  of  the  decision  maker  and  that  environment  in 
which  s/he  operates.  The  rest  of  this  discussion  concen¬ 
trates  on  achieving  a  better  understanding  of  the  conceptual 
environment  and  explaining  some  of  the  terminology  used 
in  the  remainder  of  this  paper. 

2.10  The  Decision  Maker *s  Environment; 

Conscious  human  thought  resides  in  a  conceptual 
environment  of  memory,  cognitive  processes,  affective 
reflections,  and  behavioral  responses .  These  factors 
of  the  environment  interact  to  sustain  thought  just 
like  air,  light,  water  and  earth  interact  to  sustain 
life.  Within  this  environment,  the  human  mind  combines 
these  factors  in  the  intricate  process  of  decision  making. 

All  humans  continuously  make  decisions.  However 
the  range  and  complexity  of  the  decision  spans  from 
basic  daily  decisions  of  ’when  to  eat’  to  abstract  problems 
like  ’solving  Maxwell's  equations’.  The  mind  performs 
these  feats  by  accomplishing  complex  cognitive  tasks 
like  data  collection,  situation  awareness,  alternative 
generation,  evaluation,  judgement,  choice,  etc. 


2.11  Problem  Domain  -  Problem  Space: 


There  are  three  key  term  that  need  to  ba  understood 
by  anyons  involved  in  defining  a  problem  and  identifying 
the  kernels  of  the  decision  process.  The  first  term 
is  Problem  Domain.  The  problem  domain  is  a  sphere  of 
understanding  or  range  of  problems  associated  with  a 
specific  field.  For  example,  aircraft  maintenance , 
flight  take-off,  and  crew  training  schedules  are  in 
the  problem  domain  of  scheduling. 

The  second  key  term  is  Problem  Space.  The  problem 
space'  is  a  conceptual  area  within  the  problem  domain 
that  is  defined  and  bound  by  the  factors  of  the  problem. 

The  bounds  on  the  problem  come  from  factor  limitations. 
Factors  reach  their  limits  when  they  no  longer  pertain 
to  the  specific  problem  at  hand. 

The  definitions  of  these  two  term a  falsely  lead 
one  to  believe  that  there  exists  explicit  delineation 
between  problem  domains  and  spaces.  Quite  the  contrary 
is  true.  Problems  are  not  delineated  and  are  not  easily 
identified.  The  natural  camouflage  created  by  the  lack 
of  delineation  and  differentiation  can  be  seen  in  the 
way  information  is  communicated  to  the  decision  maker. 

Problems  are  not  presented  to  decision  makers  in 
nice,  neat,  easy  to  understand  forms.  They  are  hidden 
in  the  day-to-day  noise  of  communication.  Every  decision 
maker  sends  and  receives  thousands  of  pieces  of  information 


daily,  involving  a  variaty  of  paat  and  futura  daciaiona. 

Tha  daciaion  makar  mua t  bo  conatantly  alort  to  tho  oxiatonco 
of  a  poaalblo  problam  that  would  roquiro  a  daciaion 
to  ba  aada.  To  halp  him/har  idantify  any  poaaibla  problama, 
tha  daciaion  aakar  auat  inatall  and  iaplaaiant  a  variaty 
of  aanaora  and  control  machaniaaa.  Each  of  thaaa  ayatama 
halpa  kaap  him/har  inf or mad  of  tha  atatua  of  tha  organiz¬ 
ation  . 

Concurrant  with  tha  aanaing  and  control  procaaa , 
tha  daciaion  makar  muat  alao  ba  craativa.  S/Ha  muat 
aaarch  out  and  avaluata  now  altarnativaa  to  racurring 
daciaiona.  Thay  muat  laarn  to  look  at  old  problama 

i 

in  naw  way a  and  ganarata  diffarant  altarnativaa  for 
anhancamant  of  tha  daciaion  procaaa.  Along  with  tha 
conatant  vigilanca  for  naw  altarnativaa,  tha  daciaion 
makar  muat  alao  ba  aaarching  for  naw  waya  to  maka  daciaiona. 
Tachnology  aa  wall  aa  parcaption  changaa  vary  rapidly. 

Naw  waya  to  look  at  a  problam  may  ba  axploitad  by  tha 
naw  tachnology.  Thua  tha  daciaion  makara  muat  remain 
alart  to  taka  advantaga  of  thaaa  opportunitiaa . 

Thaaa  a ra  tha  kay  functlona  and  action a  of  a  paraon 
parforming  tha  complax  cognitiva  taaka  of  daciaion  making. 
Sinca  aanaing,  control  and  craativity  ara  functiona 
of  tha  daciaion  makar,  what  than  i a  Daciaion  Making? 


There  ar«  many  variations  on  tba  definition  of 


decision  making.  Her*  are  three  that  are  commonly  seen 
in  the  literature:  1)  Decision  making  is  a  process 
that  produces  a  product  called  a  'decision* .  2)  Decision 

making  is  an  irreversible  commitment  of  resources. 

3)  Decision  making  is  'a  course  of  action  consciously 
chosen  from  available  alternatives  for  the  purpose  of 
achieving  a  desired  result.  Thus  a  decision  is  1)  a 
choice,  2)  the  result  of  conscious  mental  activity, 
and  3)  directed  toward  a  purpose*  (Hassle,  1081:170). 

Another  way  to  define  decision  making  is  to  look 
at  how  the  decision  maker  'models'  the  problem.  ‘At 
a  minimum,  complex  decision  making  involves  searching 
for  information  about  the  current  and  desired  state 
of  affairs,  inventing  possible  courses  of  action,  and 
exploring  the  impact  of  each  possible  course  of  action. 

All  decision  making  involves  predicting  the  likely  con¬ 
sequences  of  decisions,  which  suggests  that  the  decision 
maker  have  a  ‘model*  of  the  problem  situation  being 
faced*  (Brennan,  1985:130). 

2.13  The  Fo<  of  Decision  MakinS: 

The  environment  of  the  decision  maker  is  clouded 
by  several  factors  regarding  the  understanding  of  cognitive 
activities  within  the  mind.  These  factors  cause  knowledge 


about  the  daciaion  making  proceaa  and  tha  anvironmant 
that  it  reaidea  in  to  ba  obacured. 

1)  Quantity  of  factora: 

Many  daciaiona  aaam  to  ba  aimpla  at  firat  glance 
aaraly  becauae  tha  maker  faila  to  comprahand  tha  number 
of  factora  that  affact  tha  aituation.  For  axampla, 
any  acheduling  problaa  ia  initially  conaidarad  a  ralativaly 
aimpla  aaaignment  of  ona  raaourca  againat  anothar. 

Howavar ,  tha  aaaignownt  procaaa  muat  taka  into  account 
factora  that  ara  not  pravalant  at  tha  aurfaca.  Factora. 
auch  aa  tha  variabla  rata  of  production,  aorkar  unavail¬ 
ability,  and  damand  changea  ara  all  affecting  tha  final 
achadula.  'Confuaion  ia  not  uncommon  or  unhealthy  at 
thia  ataga;  however,  tha  daciaion  makar  cannot  conaidar 
all  tha  facta  and  muat  davalop  a  aalactiva  approach 
for  kaaping  tha  moat  important  and  relevant  facta  in 
mind*  (Maaaia,  1981:172).  Tha  daciaion  makar  copaa 
with  thia  confuaion  by  concentrating  on  tha  key  aapacts 
of  tha  daciaion  at  hand. 

2)  Lack  of  Judging  Probabilitiea  Under  Praaaura: 

Daciaion  makara  ara  conaiatantly  required  to  eatimate 

tha  probability  of  factor  raaulta  within  a  daciaion 
anvironmant.  Two  axamplaa  of  quaationa  that  require 
tha  daciaion  makar  to  eatimate  a  variable  are:  How 


much  conduit  is  needed  for  *  building  undor  construction? 
What  are  the  host  lengths  of  conduit?  In  both  of  thsss 
questions,  decision  estimates  of  the  total  length  of 
conduit  as  well  as  the  amount  of  waste  depend  on  the 
performance  of  the  workers.  The  decision  maker  must 
estimate  the  ability  of  the  workers.  This  kind  of  decision 
is  usually  accompanied  by  some  stress.  In  this  example 
the  stress  is  to  complete  the  building  on  time,  within 
code,  and  within  costs.  Are  people  good  natural  decision 
makSrs?  There  is  now  considerable' evidence  that  they 
are  not. 


The  major  advance  in  descriptive  research 
over  the  last  five  years  has  been  the  discovery 
that  people  systematically  violate  the  principles 
of  rational  decision  making  when  judging  probabi¬ 
lities,  making  predictions,  or  otherwise  attempting 
to  cope  with  probabilistic  tasks.  Biases 
in  judgments  of  uncertain  events  are  often 
large  and  difficult  to  eliminate.  The  source 
of  these  biases  can  be  traced  to  various  heuristics 
or  mental  strategies  that  people  vise  to  process 
information.  In  the  final  discussion  a  strong 
case  is  made  that  judgmental  biases  affect 
important  decisions  in  the  real  world.  (Howard, 
1980:9) 


3)  Human’s  Inability  to  describe  the  process: 

Understanding  how  people  make  decisions  is  essentially 
‘explaining  how  people  manage  to  cope  with  the  demands 
of  an  environment,  the  complexity  of  which  far  exceeds 
the  range  of  possible  human  responses*  (Hogarth,  no-date:C). 
Thus,  the  environment  is  clouded  by  the  inability  of 
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humans  to  describe  thair  cognitive  procaaaaa  and  ways 
of  thinking. 


4)  Comp lax  Combinations  of  Procaaaaa  usad: 

Anothar  factor  that  clouds  tha  undaratanding  of  dacision 
making  daala  with  tha  ability  to  idantify  tha  combination 
of  aimpla  procaaaaa  uaad  to  aolva  tha  problam.  Hogarth 
baliavaa  that  tha  human  mind  has  only  a  limitad  numbar 
of  stratagias  or  principlas  for  making  daciaiona.  Of  tan 
thaaa  stratagias  a ra  uaad  in  complax  combinations. 

This  combining  of  aimpla  stratagias  raquiraa  a  DSS  dasignar 
to  infar  tha  combination  and  tha  anvironmant  that  axistad 
whan  tha  combinations  wars  craatad.  This  infarancing 
procaaa  is  not  a  aimpla  task.  Without  tha  undaratanding 
of  tha  ralationahipa  dascribing  tha  combinations,  no 
understanding  of  tha  decision  process  would  be  possible. 

2.20  Educating  Decision  Makars: 

Most  formal  presentations  attempting  to  teach  dacision 
making  sat  tha  dacision  maker  down  in  a  classroom  and 
teach  him/her  *how  to  aolva  problems'.  But  does  s/ha 
learn  to  solve  problems  or  do  they  really  learn  to  apply 
tha  currant  solution  technique  to  a  given  sat  of  sifted 
data? 

Throughout  tha  entire  range  of  curriculum  dealing 
with  problam  solving,  student  dacision  makers  are  given 


the  encapsulated  problem,  which  is  fully  defined  and 
seldom,  if  at  all,  contains  extraneous  information. 

The  emphasis  is  placed  on  the  mathematical  procedures 
or  algorithms  vised  to  help  the  decision  maker  in  differ¬ 
entiating  between  alternatives  (i.e.  the  choice  process) . 

This  practice  of  problem  simplification  is  not  unique 
to  any  course  of  study.  Mathematics,  management,  engineering 
and  the  physical  sciences  follow  the  same  teaching  method. 
Students  are  very  well  prepared  to  handle  these  encapsulated 
problems,  but  the  true  state  of  the  world  is  not  this 
well  defined  or  structured. 

Students  of  decision  making  must  attain  the  skills 
of  defining  the  problem  space  and  identifying  the  kernels 
of  the  decision  process.  As  Massie  and  Douglas  put 
it,  this  is  the  'Art  of  decision  making'.  Unfortunately, 
this  process  of  defining  the  problem  and  identifying 
the  decision  process  has  not  been  addressed  by  management 
teachings.  ‘A  serious  weakness  of  the  whole  study  of 
management  has  been  Ignorance  of ,  or  lack  of  interest 
in,  how  decisions  are  made.  A  descriptive  understanding 
of  the  problem-solving  process  is  absolutely  essential 
for  decision  support.'  (Keen,  1978:15) 

There  is  an  entire  class  of  problem,  similar  to 
the  encapsulated  problems  that  are  referred  to  as  'automatic 
choice*.  The  stimulus  that  initiates  the  response  is 
so  well  learned  that  no  conscious  thought  is  given. 


In  other  words,  the  problem  was  previously  solved,  the 
solution  documented  in  detail  and  the  required  actions 
written  down  for  anyone  to  vise.  The  response  to  a  certain 
set  of  events  or  stimuli  causes  an  immediate  response 
by  the  decision  maker.  Many  jobs  are  like  this.  Factory 
assembly  lines  operate  machines  by  using  a  sequence 
of  checklist  actions.  The  worker  just  reacts  to  the 
stimuli,  movement  of  the  line,  with  the  appropriate 
actions . 

This  thesis  does  not  debate  nor  recommend  changing 
the  educational  philosophy  of  the  world  but  merely  points 
out  the  fact  that  very  few  teachers  teach  the  art  of 
problem  definition.  Other  authors  have  also  voiced 
this  concern  (Keen,  1978;  Leavitt,  1970;  Stabel,  1975). 

Why  isn't  the  art  of  problem  definition  taught?  Teachers 
surely  see  the  need  for  problem  definition  skills. 

It  is  the  contention  of  this  author  that  there  is  no 
suggested  method  or  procedure  available  for  students' 
use . 

Teachers  know  every  student  will  face  a  world  of 
complex,  entangled  problems.  Thus,  it  would  be  foolish 
to  hold  back  a  process  that  sorts  out  and  delineates 
boundaries  and  highlights  intersections  between  various 
problem  spaces.  Consequently,  the  only  answer  is  that 
a  process  of  accomplishing  problem  definition  does  not 
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2.30  The  Decision  Making  Process: 
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‘Few  people  like  problems.  Hence  the  natural  tendency 
in  problem  solving  is  to  pick  the  first  solution  that 
comes  to  mind  and  run  with  it.  The  disadvantage  of 
this  approach  is  that  you  may  run  either  off  a  cliff 
or  into  a  worse  problem  than  you  started  with.  A  better 
strategy  in  solving  problems  is  to  select  the  most  attractive 
path  from  many  ideas,  or  concepts*  (Adams,  1986:ix). 

Adams’  observation  tells  us  that  humans  tend  to 
be  lazy  in  making  decisions,  and,  as  a  result,  fail 
to  solve  the  problem.  Adams  does  recommend  a  solution 
to  this  dilemma,  and  that  is  to  approach  decision  making 
with  a  strategy. 

The  main  strategy  undertaken  by  most  decision  makers 
would  be  to  look  upon  decision  making  as  a  process . 

Cohen  describes  the  decision  making  process  as  consisting 
of  a  specific  set  of  cognitive  tasks.  Figure  2-1  depicts 
the  arrangement  of  the  key  cognitive  tasks  in  Cohen’s 
decision  process.  'First,  goals  or  objectives  must 
be  known  or  identified;  if  these  are  not  present,  then 
there  is  no  motivation  to  decide  or  act*  (Cohen,  1985:12). 

In  this  representation  of  a  decision  making  process , 
Cohen  recognizes  two  inherent  facts.  First,  there  is 
no  specific  ordering  of  the  cognitive  tasks.  Tasks 
are  performed  in  a  variety  of  sequences  based  on  the 
decision  maker  and  the  environment.  Second,  the  process 
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of  deciding  is  an  iterative  process  among  the  tasks. 

No  task  is  svsr  complstsly  finished  during  tbs  decision 
process . 
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Figure  2*1.  Potential  cognitive  subtasks  in  the 
decision-making  process. 

2.31  The  Systematic  Approach: 

Lt  Col  Robinson  pointed  out  in  TACT  6.70,  Systems 
Analysis  and  Defense  Planning,  that  'Operations  research 
may  be  defined  as  the  application  of  scientific  methods 
and  techniques  to  decision  making  problems*  (Robinson, 
1987:1).  The  scientific  methods  are  simply  'logical 
approaches  to  the  solution  of  problems  which  lend  themselves 
to  investigation*  (Metcalfe,  1966:3).  Thus,  the  curriculum, 
whose  sole  purpose  is  to  support  decision  making,  puts 
forth  the  belief  that  a  decision  maker  should  approach 
a  problem  in  a  systematic  process.  Searching  the  literature 
one  finds  as  many  variations  in  the  steps  of  problem 
solving  as  there  are  authors.  Figure  2-2  shows  several 
authors'  recommended  steps  in  the  process  jt  analysis. 


Anderson 

Massie 

1 . 

Problem  definition 

1 . 

Understand  the  situation 

2. 

Model  development 

2. 

Diagnose  and  define 

3. 

Data  preparation 

the  problem 

4. 

Model  solution 

3. 

Find  alternatives 

5. 

Report  generation 

4. 

Select  action 

(Anderson,  1976:5) 

5  . 

Secure  acceptance  of 
decision 

(Massie.  1981:171) 

Quade 

Robinson 

1. 

Formulation 

1 . 

Formulate  the  problem 

2. 

Search 

2. 

Model  the  system 

3. 

Evaluation 

3. 

Select  a  solution  technique 

4. 

Interpretation 

4. 

Solve  the  problem 

5. 

Verification 

5. 

Establish  controls  over 

(Quade,  1977:33) 

6. 

the  solution 

Implement  the  solution 

(Robinson,  1987:1) 

FIQURE  2-2.  A  Variety  of  Algorithms  for  Decision  Making 
by  Author . 


2.32  Tha  Heed  for  Problam  Idsnti f ication : 

Tha  most  intarasting  thing  about  all  of  thesa  processes 
is  tha  fact  that  thay  all  start  with  tha  sama  step. 

Every  author  recognizes  tha  importance  of  understanding 
tha  problam  before  applying  solution  techniques.  *A 
clear  and  concise  definition  of  tha  specific  problem 
of  interest  is  an  essential  first  step  on  any  operations 
research  or  quantitative  analysis  study'  (Anderson, 

1978:0).  Quade  and  Boucher  admit  that  'formulation 
is  the  most  important  stage*  (Quade,  1977:35).  The 
importance  is  again  emphasized  in  their  summary  of  systems 
analysis.  The  first  recommendation  is  to  'pay  attention 
to  problem  formulation*  (Quade,  1977:419).  Adams  proclaims 
’proper  problem  identification  is  of  extreme  importance 


in  problem  solving.  If  the  problem  is  not  properly 
isolated,  it  will  not  be  properly  solved*  (Adams,  1986:22). 
This  proclamation  was  based  on  the  fact  that  information 
is  either  inadequate  or  misleading. 

Massie  and  Douglas  also  support  the  need  for  problem 
identification  by  calling  for  an  explicit  statement 
of  the  problem.  ‘Since  it  is  impossible  to  weigh  all 
the  facts,  the  manager  must  develop  a  means  of  sifting 
out  the  relevant  ones  (figure  2-3).  In  the  classif ication 
of  these  facts,  one  can  then  define  the  problem.  The 
more  completely  the  problem  can  be  stated,  the  easier 
the  othar  steps  will  be*  (Massie,  1981:173). 


r  _  .Synptoas] 

!?eassessient|  L - 1 

i - - — - - 1 

Fijure  2-3.  Inputs  to  diasnosins  and  defining  the  problen. 
(Bassie,  1981:173) 


To  achieve  the  understanding  of  the  required  decision 


process  and  criteria,  the  problem  must  be  fully  defined. 


“In  a  ’wall  formed  problem’  we  know  the  initial  state, 
the  goal  atate,  and  the  operatora.  From  the8e,  we  can 
ayatematically  generate  all  the  intermediate  states, 
and  hence  we  can  theoretically  develop  a  ’map’  of  the 
entire  problem  space  (Harmon  and  Xing,  1985:28).* 

The  field  of  OB  presents  hundreds  of  text  books 
and  articles  depicting  detailed  algorithms  on  how  to 
solve  problems.  Unf ortunately  this  author  has  not  found 
any  algorithms  on  suggested  problem  definition  or  problem 
diagnosis  procedures.  Yet,  every  text  or  article  dealing 
with  the  process  of  analysis  lists  the  ’problem  formulation’ 
'problem  definition’,  or  ’problem  diagnosis’  as  the 
first  step. 

2 . 33  The  Art  of  Problem  Definition: 

If  it  is  as  important  as  Anderson,  Quads  and  others 
believe,  why  then  has  it  been  so  hard  to  develop  a  procedure 
of  problem  definition?  Massie  and  Douglas  put  forth 
the  argument  that  problem  diagnosis  is  an  art.  They 
give  the  example  of  a  patient  going  to  the  doctor  with 
a  stomach  ache.  The  doctor  just  doesn’t  record  stomach 
ache.  He  performs  an  examination  to  find  the  cause 
of  the  ache.  Once  the  cause  is  found,  he  prescribes 
the  approved  treatment  for  the  cure.  The  same  is  true 
of  the  decision  maker.  He/she  must  not  be  distracted 
with  just  the  symptoms  but  search  further  to  find  the 


cause.  This  is  ths  art. 


' The  diagnosis  and  definition  of  the  problem  is 
a  recurring  process.  Beassessment  and  reconsideration 
of  the  issues  help  keep  the  decision-making  process 
realistic  and  in  touch  with  a  changing  set  of  conditions* 
(Massie,  1981:173).  Thus ,  what  we  need  as  decision 
makers  is  an  art  lesson  and  the  tools  to  perform  the 
art.  Like  a  painter,  the  decision  maker  must  learn 
to  use  the  tools  that  spread  the  paint.  Then  he  must 
practice  and  develop  insight  to  make  the  canvas  come 
alive  with  a  correct  problem  formulation. 

2.34  DSS  and  Problem  Definition: 

Not  only  is  this  chapter  concerned  with  the  manual 
process  of  decision  making  but  the  automated  support 
for  the  human  as  well.  These  decision  support  systems 
require  even  more  explicit  problem  definitions  because 
4>f  the  need  to  design  the  system.  'Decision  support 
requires  a  detailed  understanding  of  decision  making 
in  organizations.  A  descriptive  framework  provides 
the  basis  for  prescriptive  design;  that  is,  to  ’improve’ 
a  decision  process,  one  must  first  define  and  analyze 
it*  (Keen.  1978:01). 

Based  on  this  need  for  problem  identification, 
a  process  for  performing  the  task  must  be  developed. 

The  process  must  be  simple,  flexible  and  easily  applied 


to  any  problem  space  or  domain. 

2.35  Requirements  for  a  Capturing  Process : 

To  capture  the  factors  of  a  problem  so  that  its 
problem  space  can  be  identified,  described,  and  bounded 
calls  for  a  diagnosis.  This  diagnosis  must  discover 
several  facts  about  the  problem  so  that  the  remainder 
of  the  decision  process  is  enhanced. 

Massie  and  Douglas  describe  a  good  diagnosis  as 
one  which  has  both  ‘the  reasons  leading  up  to  the  need 
for  a  decision  and  obstacles  standing  in  the  way  of 
achieving  the  objectives.  A  diagnosis  consists  of  a 
search  for  symptoms.  The  search  must  be  based  on  a 
clear  recognition  of  the  desired  results,  the  obstacles 
faced,  and  the  limits  within  which  a  solution  must  fall' 
(Massie,  1981:173). 

Another  way  to  describe  the  problem  space  is  to 
define  it  in  three  dimensions.  Bartee  describes  the 
problem  solving  space  by  looking  at  the  problem  taxonomy, 
problem  solving  modes,  and  problem  process.  The  problem 
space  is  sketched  with  regard  to  personalization,  col¬ 
laboration,  institutionalization,  and  socialization. 

These  are  the  ways  Bartee  sees  the  decision  maker  developing 
the  ability  to  solve  problems.  Kiss  judges  from  his 
observations  that  *we  are  now  between  the  second  and 
third  phases .  Where  we  use  conceptual  frames  for  pre- 


scriptive  types  of  problem  solving,  combined  with  experi¬ 
ences,  but  involving  some  behavioral  aspects*  (Edwards, 
1964: 14-19) 


Just  as  the  other  steps  of  the  decision  process 
are  iterative  and  recurring,  so  is  the  diagnosis  or 
problem  definition  step.  As  the  decision  maker  progresses 
through  the  sequence  of  steps  to  produce  the  decision, 
s/he  must  continually  reassess  and  reconsider  the  issues 
of  the  problem.  This  reassessment  keeps  the  decision 
process  ‘realistic  and  in  touch  with  a  changing  set 
of  conditions*  (Hassle,  1981:173). 

Based  on  this  need  for  problem  identification, 
a  process  for  performing  the  task  must  be  developed. 

The  process  must  be  simple,  flexible  and  easily  applied 
to  any  problem. 

2.36  Conceptualization : 

Of  all  the  cognitive  processes  mentioned  and  discussed 
in  this  chapter,  the  key  to  understanding  how  a  capturing 
process  would  work  is  conceptualization. 

Conceptualization,  or  the  process  by  which  one 
has  ideas,  is  the  decision  maker’s  ability  to  create 
concepts  in  the  mind  and  link  them  together  into  a  framework 
of  understanding.  'This  process  is  a  key  one  in  problem 
solving,  since  the  more  creative  concepts  you  have  to 
choose  from,  the  better*  (Adams,  1986:7). 


Conceptualization  is  not  monolithic,  but  has  many 
and  varisd  'levels  of  conceptualization’.  Each  level 
contains  a  set  of  linked  concepts.  Each  set  of  concepts 
is  a  layer  that  can  and  does  have  links  to  other  layers. 

The  layers  at  the  top  levels  are  very  abstract  and  free. 

These  levels  of  conceptualization  may  address  a  variety 
of  problem  spaces  and  even  range  across  several  domains. 

The  lower  the  level  of  conceptualization ,  the  greater 
the  increase  in  detail  and  the  more  focus  applied  to 
the  problem  space.  The  level  of  conceptualization  becomes 
more  explicit  and  resides  with  the  tiniest  details  of 
a  problem  space. 

2 . 40  Good  Decisions: 

If  a  decision  maker  understands  the  levels  of  conceptual¬ 
ization  inherent  in  the  problem  and  completes  an  explicit 
diagnosis  of  the  problem  space,  then  a  ’good  decision’ 
is  more  likely.  *A  good  decision  depends  upon  the  maker’s 
being  consciously  aware  of  the  factors  that  set  the 
stage  for  the  decision*  (Massie,  1981:171). 

Nothing  is  more  elusive  than  the  evaluation  of 
a  decision  as  to  its  quality.  What  is  meant  by  a  ’good 
decision'?  Is  a  good  decision  different  than  a  good 
outcome?  If  so  how? 

Before  delving  into  problem  definition  process , 
a  short  detour  discussion  of  'good  decision’  is  necessary. 


This  dstour  will  offer  a  definition  of  'good  decision’ 
so  that  the  decision  maker  knows  what  to  strive  for 
in  the  decision  making  process. 

The  first  definition  comes  from  the  field  of  decision 
analysis.  ‘A  good  decision  is  one  based  on  the  information 
values  and  preferences  of  a  decision  maker.  A  good 
outcome  is  one  that  is  favorably  regarded  by  a  decision 
maker*  (Matheson,  1908:24).  Although  a  decision  maker 
has  no  control  over  the  final  outcome,  he  does  have 
control  over  the  decision.  Therefore  as  Howard  puts 
it  '...making  a  good  decision  is  only  doing  the  best 
we  can  to  increase  the  chances  of  a  good  outcome*  (Howard, 
1973:83) . 

Based  on  this  discussion,  a  'good  decision’  is 
one  where  the  decision  maker  tries  to  obtain  the  desired 
outcome  using  the  most  effective  and  efficient  means 
available.  S/he  does  this  by  identifying  the  possible 
outcomes,  and  then  using  all  the  tools  available  to 
act  in  a  way  that  increases  the  chance  for  the  desired 
result.  These  acts  and  their  sequence  then  is  a  ’good 
decision’ . 

A  decision  maker's  problems  are  not  trivial.  All 
complex  problems  require  some  form  of  human  judgement 
and  cognitive  processing.  The  human  needs  support  when 
s/he  is  overwhelmed  by  the  requirements  of  the  decision 
task.  A  decision  maker  is  vulnerable  to  a  decision 
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task  when  th*  rate  at  which  s/he  must  do  th*  task  *xc**ds 
his/hsr  capacity,  or  his/hsr  ability  to  think  is  insufficient 
to  ths  task  at  hand.  Thssa  ara  th*  problems  wh*r*  any 
decision  maker  needs  help.  These  are  th*  situations 
which  call  for  decision  support. 

2.50  Decision  Support  Systems: 

Because  decision  makers  do  become  overwhelmed  by 
their  decision  task,  they  need  some  type  of  help  or 
support.  Decision  support  systems  offer  a  means  to 
aid  the  decision  maker.  'Decision  support  implies  the 
us*  of  computer  hardware  and  software  to: 

1]  Assist  managers  in  their  decision  process 
in  semi -structured  tasks. 

2]  Support,  rather  than  replace,  managerial 
judgement . 

3]  Improve  the  ef f ecti veness  of  decisionmaking 
rather  than  its  efficiency.* 

(Keen.  1978:1) 

However,  th*  us*  of  a  computer  is  not  absolutely  necessary 
for  the  system  to  be  classified  as  a  DSS  (Keen,  1978:58). 

2.51  Value  of  DSS: 

For  a  system  to  be  a  real  value  to  the  decision 
maker  it  must  provide  him/her  with  effective  support. 

The  design  of  th*  system  must  reflect  an  understanding 
of  the  management  decision  process.  The  manager,  on 
the  other  hand,  must  clearly  recognize  the  criteria 
for  developing  th*  aid  and  power  of  th*  resulting  output. 
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’Perhapa  the  moat  practical  aapact  of  tha  DSS  approach 
la  that  it  allowa  managers  to  initiata,  design,  and 
control  tha  implamantation  of  a  ayataa.  That  ia.  a 
DSS  ia  built  around  a  dacia ionmaking  taak  and  whila 
tha  tachnical  iaauaa  may  ba  axtramaly  comp lax,  tha  main 
focua  ia  managerial’  (Xaan,  1978:13). 


2.32  Efflciancy  va  Ef f activanaaa : 

Since  every  human  atrivaa  for  tha  highaat  auccaaa 
poaaibla,  ha'll  aaarch  for  tha  beat  daciaion  poaaibla. 

Thia  aaarch  for  tha  beat  daciaion  will  aoon  become  a 
trade-off  between  efficient  and  affective  daciaion  making. 
Thaaa  two  terma  become  aaaantial  in  underatanding  what 
a  DSS  ia  to  provide  to  tha  daciaion  maker.  ‘Efficiency 
ia  performing  a  given  taak  a a  wall  aa  poaaibla  in  relation 
to  aoma  predefined  performance  criterion.  Ef f activanaaa 
involvaa  identifying  what  ahould  ba  dona  and  enauring 
that  tha  choaan  criterion  ia  tha  relevant  one.*  (Kean, 
1978:7) 

In  providing  aupport  to  a  daciaion  maker,  trada-offa 
may  have  to  taka  place.  A  daciaion  maker  doaa  not  have 
tha  time  for  all  poaaibla  altarnativaa  to  ba  enumerated 
and  evaluated  in  light  of  their  ef facta  on  tha  outcome. 

Tha  daciaion  maker  ia  conatrainad  by  time,  money  and 
tha  ability  to  comprehend.  Tha  aupport  ayatem  muat 
alao  ba  efficient  in  tha  praaantation  of  tha  information. 


Tha  Aid  should  concantrata  on  tha  most  partinant  information 
and  prasant  it  in  a  claar  concisa  mannar  that  will  not 
int arfara  with  tha  dacision  makar ’ s  cognitiva  procas- 
sas .  'Dafining  af f activanass  raquiras  a  datailad  undar- 
standing  of  tha  variablas  that  affact  parformanca*  (Kaan, 
1078: 10)  . 


2.53  Parcaptlons  Inharitad  by  tha  DSS: 

Kaan  and  Scott-Morton  go  on  to  claim  that  tha  kay 
quastion  for  anyona  building  a  DSS  is:  ‘What  spacific 
dacision  or  dacision  procass  ara  wa  trying  to  support?' 

Whan  building  a  DSS,  tha  dasignar  must  raaliza  tha 
dacision  is  not  static  but  constantly  changing.  His 
parcaption  of  tha  problam  and  tha  valuas  s/ha  placas 
on  tha  various  outcomas  continually  changa  ovar  tima. 

Thus  tha  dacision  makar  is  facing  a  complax  problam 
that  cannot  ba  fully  automatad  nor  raducad  to  an  automatic 
choica.  ‘This  parspactiva  raquiras  tha  davalopmant 
of  mathodological  tools  to  axamina  tha  kay  dacisions 
of  managars  and  to  dafina  tha  information  that  can  or 
should  ba  mada  availabla  to  tham.  It  suggasts  that 
for  a  managar's  information  systam,  ona  should  start 
from  his/har  dacision  making  activitias  and  mash  tha 
systam  into  tha  usar's  problam  and  naads  (Kaan,  1978:58).* 

Scott-  Morton  racognizas  that  all  managarial  dacisions 
hava  two  parts  involvad  in  tha  task.  By  avaluating 


the  task  we  should  Identify  the  key  decisions  it  involves, 
and  then  identify  the  parts  of  the  process  that  seem 
structured  and  which  require  human  judgement  (Keen, 

1078  :  1 1 )  . 


2.54  Concept  Mapping: 

In  this  thesis  effort  a  new  tool  for  the  decision 
maker  is  presented.  It  is  designed  to  meet  the  requirements 
for  capturing  the  problem  space.  By  identifying  the 
key  factors  and  ideas  of  a  problem  space  and  representing 
their  relationships  to  each  other,  the  problem  will 
be  identified  and  described  by  a  map  of  the  concepts. 

The  individual  elements  or  tasks  used  in  making  a  decision 
will  be  identified  and  defined  by  repeatedly  mapping 
the  user’s  or  users’  preception  of  the  decision  process. 

This  tool  is  concept  mapping  (CM) .  CM  is  taken 
from  the  cognitive  theory  of  education.  'Concept  maps 
work  to  make  clearly  evident  to  both  students  and  teachers 
the  small  number  of  key  ideas  they  must  focus  upon  for 
any  specific  learning  task*  (Oowin,  1982:11-2).  Used 
in  this  context,  concept  mapping  becomes  a  'technique 
for  externalizing  concepts  and  propositions*  (Qowin, 

1982:  I I -3) . 

Concept  Mapping  is  proposed  to  help  the  decision 
maker  better  understand  the  problem  and  limit  the  problem 
space.  It  is  a  communication  tool  that  helps  decision 
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makers  depict  relationships  between  concepts  and  lend 


agreement  to  those  relationships .  Thus,  a  decision 
maker  can  fully  map  out  his  perception  of  a  problem 
and  view  it  in  a  variety  of  ways.  However,  the  greatest 
power  of  this  tool  lies  in  human  inconsistencies  and 
variable  perceptions.  As  the  decision  maker  works  on 
a  problem,  time  and  changes  in  the  environment  help 
to  change  his  perceptions.  If  he  has  used  the  tool 
and  made  his  maps,  he  can  review  them  and  see  changes 
and  consistencies  in  perception.  This  comparison  of 
maps  (overlaying)  is  expected  to  greatly  aid  the  decision 
maker  in  problem  diagnosis. 

2.5S  The  Problem  Definition  Process: 

Just  introducing  concept  mapping  as  a  tool  for 
decision  makers  is  not  enough.  The  tool  and  its  use 
must  be  shown  to  the  decision  maker  as  an  integral  part 
of  a  process.  This  process  establishes  limits  on  a 
problem  space  and  defines  the  problem  explicitly.  The 
application  of  concept  mapping  is  tied  to  an  entire 
problem  definition  process.  This  process  is  not  to 
be  taken  as  the  only  possible  process  of  problem  definition 
but  is  an  approach  to  help  lend  structure  for  a  completely 
unstructured  arena.  The  direct  application  of  the  problem 
definition  process  will  be  demonstrated  best  in  the 
adaptive  design  of  decision  support  systems,  (chapter-5.) 


2.50  Whv  is  it  important  to  know  and  define  the  Kernel?: 


A s  mentioned  earlier,  DSS  requires  an  explicit 
definition  of  the  problem  and  the  decision  process  that 
solves  that  problem.  Without  the  information  there 
is  no  basis  for  the  design  and  no  method  of  determining 
the  effectiveness  of  the  system. 

The  kernel  is  a  key  decision  element  within  the 
decision  process.  It  provides  a  starting  point  for 
design  of  the  DSS.  Its  discovery  is  based  on  the  ability 
of  the  designer  to  identify  it  among  the  many  other 
concepts  and  possible  kernels,  and  the  current  perception 
of  the  designer  as  he  searches  the  decision  process. 

Given  more  than  one  kernel  available  in  a  decision 
process,  an  evaluation  of  which  kernel  to  use  in  the 
design  of  the  DSS  can  be  made.  The  kernels  can  be  compared 
based  on  a  variety  of  constraints.  The  most  common 
constraints  are  technology,  cost,  time  to  develop,  the 
designer’s  expertise  and  the  user’s  perspective. 

Once  the  kernel  is  chosen  for  the  DSS,  the  impact 
on  the  final  product  is  as  important  as  laying  the  corner¬ 
stone  of  a  building.  Changes  can  be  made  during  the 
development,  but  the  direction  and  emphasis  is  set. 

For  this  reason  alone,  the  discovery  of  the  most  appro¬ 
priate  kernel  of  a  decision  process  is  paramount  for 
the  DSS’s  success. 
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2 . 80  Conclusion : 


This  chapter  has  introduced  the  world  of  the  decision 
maker  in  terms  of  the  environment  and  the  requirements 
s/he  has  for  defining  a  problem  and  identifying  the 
kernels  of  a  decision  process. 

The  remainder  of  this  paper's  purpose  is  two-fold. 
First,  it  brings  greater  understanding  to  these  cognitive 
processes  of  problem  definition  and  kernel  identification. 
Second,  it  introduces,  demonstrates  and  evaluates  a 
tool  and  procedure  that  aid  these  cognitive  processes. 


Chapter  3 


Concept  Mapping 


3.00  Introduction : 

This  chapter  explains  concept  mapping  through  a 
series  of  discussions.  The  first  set  discusses  four 
topics  which  describe  and  contrast  a  variety  of  cognitive 
modeling  schemes.  The  first  topic  defines  concept  mapping 
according  to  its  educational  derivation.  The  second 
topic  is  an  overview  of  the  various  cognitive  knowledge 
representation  models.  The  third  topic  explores  the 
differences  between  the  goals,  purposes  and  abilities 
of  the  models.  Finally,  key  definitions  of  concept 
mapping  are  presented  as  it  applies  to  the  problem  definition 
process . 

The  theoretical  basis  supporting  concept  mapping 
is  briefly  introduced  in  the  second  set  of  discussions. 

Three  theories  are  presented  which  give  insight  into 
the  mind's  function.  These  theories  are  then  supported 
by  a  series  of  observations  and  views  taken  from  various 
researchers  and  their  findings.  Finally,  a  summary 
of  justifications  for  concept  mapping  is  offered. 

3.10  What  is  Concept  Mapping? 

This  discussion  overviews  several  topics.  The 


first  topic  is  a  description  of  the  concept  map  as  seen 


and  developed  by  educational  researchers.  The  second 


discussion  reviews  the  various  knowledge  representation 
systems.  Finally,  the  information  presented  is  summarized 
and  a  combined  definition  of  concept  mapping  is  offered. 
This  final  definition  of  concept  mapping  is  from  the 
view  point  of  applying  concept  mapping  to  the  realm 
of  problem  definition. 

3.11  Concept  Maps  -  Educational  Derivation: 

A  concept  map  is  two  or  more  concepts  that  are 
linked  to  each  other  depicting  a  meaningful  relationship. 
Concepts  are  objects  or  events  which  are  assigned  a 
semantic  label.  Dog,  chair,  and  raining  are  all  examples 
of  concepts.  The  linking  words  are  generally  the  verbs, 
but  adjectives,  adverbs,  prepositions,  and  sometimes 
nouns  can  also  link  concepts  in  meaningful  ways.  When 
a  map  is  drawn  showing  its  relationships,  the  result 
is  a  schematic  device  that  represents  a  set  of  concept 
meanings  embedded  in  a  framework  of  propositions  (Gowin, 
1082:2. 1) . 

‘Concept  maps  are  intended  to  represent  meaningful 
relationships  between  concepts  in  the  form  of  propositions 
Propositions  are  two  or  more  concept  labels  linked  by 
words  in  a  semantic  unit.  In  its  simplest  form,  a  concept 
map  would  be  just  two  concepts  connected  by  a  ’linking 
word'  and  forming  a  proposition..’  (Gowin,  1982:2.1) 


Concept  maps  are  very  successful  in  providing  three 
benefits  to  the  user.  These  benefits  are  1)  identifica¬ 
tion  of  the  small  number  of  key  ideas  within  a  subject, 

2)  a  visual  road  map  showing  the  conceptual  journey, 
and  3)  a  schematic  summary  of  the  cognitive  domain 
of  interest.  These  are  powerful  tools  that  aid  a  user 
in  translating  understanding  of  a  subject  to  another. 

Concept  maps  are  also  very  informative  in  their 
design.  As  they  are  constructed,  a  hierarchy  is  set 
up  among  the  concepts.  This  hierarchy  is  dependent 
only  upon  the  builder’s  understanding  or  meanings  that 
s/he  wants  to  show  in  the  relationships  of  the  concepts. 
Based  on  this  hierarchy,  the  embedded  meaning  of  the 
relationships  and  the  arrangement  of  the  concepts  give 
a  specific  meaning  to  the  subject  matter  or  domain. 

One  way  to  look  at  this  function  of  concept  maps  is 
to  look  at  the  way  a  subject  matter  is  organized  for 
teaching.  'Since  meaningful  learning  proceeds  most 
easily  when  new  concepts  or  concept  meanings  are  subsumed 
under  broader  more  inclusive  concepts,  concept  maps 
should  be  hierarchical.  The  more  general,  more  inclusive 
concepts  should  be  at  the  top  of  the  map,  with  progressively 
more  specific,  less  inclusive  concepts  arranged  subord¬ 
inate^*  (Qowin,  1982:2.2).  Figure  3-1  shows  a  represent¬ 
ative  concept  map.  This  map  show  the  meaning  relationships 
between  each  of  the  concepts  as  well  as  the  hierarchical 


relationship . 

One  more  very  important  function  of  concept  maps 
is  their  flexibility.  Depending  on  the  user's  view 
of  the  concepts  and  their  relationships  the  superordinate- 
subordinate  relationships  will  change.  Concept  mapping 
allows  the  user  to  ‘pull  up*  a  subordinate  concept  to 
a  superordinate  position  and  rearrange  the  relationships 
to  the  other  concepts.  This  function  is  called  the 
‘Rubber-Sheet*  effect.  This  is  the  same  type  of  cognitive 
function  that  occurs  in  the  mind  and  results  in  the 
alternate  meanings  associated  with  objects  and  events. 

Figure  3-2  show  the  same  group  of  concepts  show  in  figure 
3-1 ,  but  the  ordonnance  has  been  changed  to  reflect 

a  new  meaning  or  emphasis  in  the  domain.  Some  of  the 

\ 

concepts  have  been  dropped  because  they  are  no  longer 
necessary  for  the  meaning  that  is  being  transferred 
or  negotiated.  Also,  some  of  the  links  have  changed 
to  show  different  meanings. 

Extrapolating  all  of  these  functions  and  definitions, 
concept  mapping  is  a  technique  for  externalizing  concepts 
and  propositions  as  they  are  organized  in  the  mind. 

Thus,  a  concept  map  becomes  a  forum  or  tool  for  two 

or  more  individuals  to  negotiate  meanings.  This  negotiation 

of  meaning  is  the  basic  purpose  for  concept  maps  in 


education . 
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A  concept  map  for  water  showing  soma  related 
concepts  and  proposi tions .  (Gowin,  1982:Fig2.1) 
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Figure  3-2.  A  concept  map  for  states  showing  the  ’Rubber 
Sheet*  effect. 


3.12  Knowledge  Representation  Systems. 


There  art  stvtral  knowledge  representation  schemes 
derived  by  artificial  intelligence  research.  These 
include  such  tools  as  Semantic  Networks,  Extended  Semantic 
Hierarchical  models,  Enti ty-Relationships  models,  Object- 
Attribute-Value  triplets,  Rules,  Frames,  and  Logical 
Expressions.  Each  of  these  tools  have  various  advantages 
and  disadvantages  depending  on  the  user’s  needs.  Below 
is  a  brief  description  of  each  of  these  methods. 

Semantic  Networks  -  *A  semantic  network  is  a  collection 
of  objects  called  nodes.  The  nodes  are  connected  together 
by  arcs  or  links.  Ordinarily  the  nodes  and  links  are 
labeled.*  (Harmon,  1985:35)  The  main  advantage  of  thi3 
method  is  its  flexibility  and  ability  to  inherit  meaning 
from  the  relationships .  Semantic  nets  are  similar  to 
concept  maps. 

Extended  Semantic  Hierarchical  Models  -  ’The  Semantic 
Hierarchical  Model  (SHM+)  is  an  example  of  a  data  model 
based  on  semantic  networks.  SHM+  uses  the  abstraction 
concept  to  form  a  hierarchical  network.*  (Handgraaf , 

1980:39) 

Entity-Relationship  models  -  Peter  Chen  defines 
an  entity  as  *a  thing  which  can  be  distinctly  identified* 
(Handgraaf,  1980:21).  He  goes  on  to  define  the  relation¬ 
ship  as  *an  association  among  entities*  (Handgraff, 

1980:21).  A  relationship  can  have  many  entities  associated 


with  it.  ‘Works  for*  is  a  relationship  of  employees 
to  an  employer.  In  that  example  there  are  many  entities 
in  employees  but  only  one  in  employer.  ‘The  'role' 
of  an  entity  in  a  relationship  is  a  function  that  it 
performs  in  the  relationship*  (Handgraaf,  1980:21). 

The  Entity-  Relationship  model  is  an  excellent  tool 
for  designing  databases,  but  lacks  the  hierarchical 
and  inheritance  functions  found  in  SHM+ . 


Object-Attribute-Value  triplets  -  Objects  are  either 
physical  or  conceptual  entities.  Attributes  include 
the  general  characteristics  or  properties  associated 
with  the  entity.  The  value  member  of  the  triplet  specifies 
the  specific  nature  of  the  attribute  in  a  particular 
situation.  (Harmon,  1985:38) 

Rules  -  ‘Rules  are  used  to  represent  relationships 
and  can  be  used  with  many  knowledge  representation  schemes. 
One  of  the  basic  structures  of  rules  follows  an  'if 
then’  format.  Qiven  a  premise  has  occurred  or  is  true 
then  a  conclusion  is  presented.  (Harmon,  1985:42-43) 

Frames  -  ‘A  frame  is  a  description  of  an  object 
that  contains  slots  for  all  of  the  Information  associated 
with  the  object.*  (Harmon,  1985:44)  Frames  can  hold 
both  declarative  and  procedural  representation  o i  facts. 
These  are  two  different  strategies  that  aid  in  building 
and  using  relationships  between  entities. 

Logical  Expression  -  There  are  a  variety  of  logical 


systems.  Harmon  and  King  summarize  both  Propositional 
Logic  and  Predicate  Calculus.  Again  these  system  establish 
relationships  between  entities  or  objects  through  asser¬ 
tions.  Thus  the  assertion  must  be  established  as  either 
true  or  false. 

All  of  these  are  schemes  attempted  to  translate 
meaning  or  understanding  by  using  a  variety  of  forms. 

No  one  scheme  is  right  nor  wrong.  Each  scheme  has  its 
specific  area  where  it  works  better  than  another.  But, 
the  key  question  is:  Do  they  depict  the  relationships 
between  entities  and  translate  that  meaning?  'Any  meaning 
representation  system,  either  human  or  mechanical ,  must 
make  explicit  exactly  what  the  relationships  between 
concepts  underlying  a  verb  are.'  ISchank,  l(JU4:9Uj 

b.ib  Differences  between  Concept  Mapping  and  other  Schemes: 

The  technique  of  concept  mapping  is  different  and 
unique  from  knowledge  representation  systems  in  three 
ways : 

1)  The  first  difference  is  the  goals  of  the  systems. 
Concept  mapping  is  a  knowledge  acquisition  method. 

Its  main  goal  is  to  capture  the  understanding  an  expert 
has  about  a  problem.  The  acquisition  process  includes 
both  the  conceptualization  (the  individual's  perception 
of  the  problem  space)  and  solution  or  decision  process 
of  the  problem.  The  other  systems  described  are  knowledge 


representation  systems.  '1‘ne  Knowledge  representation 
system  is  an  encoding  process  of  facts  and  relationships. 

* The  'process'  of  extracting  Knowledge  from  an  expert 
is  called  'Knowledge  acquisition*,  wnereas  the  'procedure' 
of  encoding  it  in  a  program  is  called  'Knowledge  represent¬ 
ation'  and  techniques  to  use  this  Knowledge  are  called 
'Knowledge  manipulation  and  retrieval'* 
l  fasdi ,  1UB9 : 12)  . 

2)  The  second  difference  between  concept  mapping 
and  these  other  schemes  is  the  purpose  of  the  methods. 

Concept  mapping's  main  purpose  is  to  capture  an  individual's 
understanding  of  a  domain  and  then  translate  or  negotiate 
the  meaning  with  another  individual.  The  Knowledge 
representation  systems  are  designed  specifically  for 
relating  meaning  so  machines  can  operate  on  the  relationships 
and  conclude  the  same  results  as  the  human  mind.  There 
is  a  difference  in  these  operations  of  translating  meaning. 
That  difference  is  locKed  in  the  understanding  of  the 
concept  "understand*. 

'The  basic  idea  in  understanding,  whether  by  computer 
or  by  people,  is  first  to  figure  out  what  concepts  are 
being  communicated  and  then  to  use  those  concepts  to 
help  in  figuring  out  what  else  might  be  the  case.  Once 
we  Know  there  was  a  ‘giving'  action  we  Know  that  there 
was  a  'taKing'  and  a  'receiving';  we  Know  that  there 
was  an  object  and  that  someone  now  has  it  and  will  probably 


use  it  for  whatever  it  is  normally  used  for.  Ascertaining 
this  kind  of  information  is  what  understanding  is  all 
about'  (Schank,  iyu4:VV). 

Hi  The  third  diffaranca  lias  in  the  abilities 
of  the  systems.  'l'o  properly  capture  the  knowledge  of 
an  expert,  the  tool  must  be  able  to  reflect  the  cognitive 
and  affective  functions  of  the  mind.  The  tool  must 
be  able  to  give  multiple  meanings  and  describe  feelings 
when  necessary.  Ail  but  concept  mapping,  SHM+ ,  and 
some  semantic  networks,  are  rather  rigid  in  their  structure 
They  are  not  flexible.  Therefore,  it  is  less  convenient 
to  represent  multiple  meanings  between  entities. 

Handgraaf  refers  to  the  flexibility  of  a  conceptual 
model  as  semantic  relativism.  'Semantic  relativism 
refers  to  the  ability  of  the  user  to  dynamically  change 
the  way  data  and  relationships  are  viewed  within  an 
application.  if  a  model  is  to  successfully  move  into 
the  realm  of  conceptual  modeling,  it  should  not  restrict 
the  user  to  one  view  or  another'  (Handgraaf,  1980:17). 

This  flexibility  function  will  also  be  described  later 
as  two  separate  functions  called  'progressive  differenti¬ 
ation*  and  'integrative  reconciliation'.  Concept  mapping 
has  the  function  of  'rubber  sheet'  that  gives  it  the 
flexibility  necessary  to  view  concepts  in  different 
meaningful  relationships . 

(iowin  points  to  the  need  for  cognitive  modeling 


to  describe  fooling*.  Cognitive  processes  and  memory 


recall  are  tied  to  previous  feelings  or  emotions.  Kor 
example,  if  a  person  thinks  of  a  birthday  party  feelings 
of  Joy,  excitement,  or  anxiety  may  accompany  the  memories. 
To  capture  the  true  relationship  among  a  group  of  entities, 
the  emotions  they  invoke  must  also  be  captured.  'These 
new  'cognitive  science'  models  fail  to  connect  thinking 
with  feeling,  partly  because  the  computer  metaphor  on 
which  they  are  based  does  not  involve  feelings'  Uiowin, 
1282:1.8).  Handgraaf  also  points  out  the  importance 
for  concept  models  to  capture  the  behavioral  aspects. 

The  definitions  presented  below  define  concept 
mapping  with  respect  to  its  application  in  the  problem 
definition  process  and  its  goals,  purposes,  and  function¬ 
ality  described  above. 

A  Concept  Map  is  a  tool  of  knowledge  acquisition 
that  translates  and  negotiates  meanings  between  individuals 

Concept  Mapping  is  the  process  of  knowledge  acquisi¬ 
tion  that  captures  an  expert's  conceptual  structure 
of  a  problem. 

3.20  The  Supporting  Theory  of  Concept  Mapping. 

This  discussion  presents  three  basic  theories  of 
the  human  mind  and  how  it  stores  and  retrieves  information, 
kach  of  these  theories  are  very  similar,  yet  come  from 
three  different  fields  of  study.  Ail  the  theories  lay 


the  lam*  basic  foundation  for  concept  mapping.  The 
first  discussion  describes  the  current  theory  of  how 
the  mind  physically  works  using  the  Knowledge- line 
or  K-line'  idea.  Cognitive  psychology  offers  the  schema 
theory  and  shows  its  application  to  learning.  The  third 
discussion  presents  Ausubei's  theory  of  cognitive  learning. 
Koilowlng  these  descriptions  are  several  views  and  obser¬ 
vations  on  conceptual  structure.  All  of  these  theories 
and  views  combine  to  show  the  functions  of  the  human 


'You  want  to  repair  a  bicycle.  before 
you  start,  smear  your  hands  with  red  paint. 

Then  every  tool  you  need  to  use  will  end  up 
with  red  marks  on  it.  When  you're  done,  just 
remember  that  red  means  'good  for  fixing  bicycles.' 

Next  time  you  fix  a  bicycle,  you  can  save 
time  by  taking  out  all  the  red-marked  tools 
in  advance . ’ 

'If  you  use  different  colors  for  different 
jobs,  some  tool  will  end  up  marked  with  several 
colors.  That  is,  each  agent  can  become  attached 
to  many  different  K-iines.  Later,  when  there's 
a  job  to  do,  just  activate  the  proper  K-line 
for  that  kind  of  job,  and  ail  the  tools  used 
in  the  past  for  similar  jobs  will  automatically 
become  available.'  (Minsky,  lUUtt:B2) 


based  on  K-line  theory,  human  minds  are  filled 
with  chunks  of  agents  that  are  connected  by  the  same 
K-iine.  When  humans  remember,  the  K-line  reactivates 
the  connected  agents  and  creates  the  idea.  If  the  agents 
were  a  solution  to  a  problem  and  a  similar  problem  is 
encountered,  then  agents  of  the  first  problem  may  be 
activated  as  possible  solutions  to  the  new  problem. 

The  ideal  performance  of  the  mind  would  then  select 
the  most  appropriate  agents  necessary  to  solve  the  problem 
This  results  in  establishing  new  K-iines  for  the  second 
problem,  and  tying  agents  to  more  than  one  K-line. 

The  K-line  concept  is  expanded  by  the  'Level-band' 
theory.  This  is  basically  the  way  the  mind  links  agents 
at  different  levels  of  strength.  'We  learn  by  attaching 
agents  to  K-lines,  but  we  don't  attach  them  ail  with 
equal  firmness.  instead,  we  make  stronger  connections 


at  a  certain  level  of  detail,  but  we  make  weaker  connec- 
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tions  to  higher  and  lowtr  levels .  A  K-line  for  a  kit« 


might  include  properties  like  these: 
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Figure  3 -a .  (Minsky,  iya«:Btn 


Another  expansion  of  the  K-iine  theory  is  the  idea 


of  ’level*.  The  level  is  a  way  that  the  level-band 


idea  can  describe  the  details  within  the  memory.  ’The 


concept  of  a  level-band  can  be  applied  not  only  to 


descriptions  of  things,  but  also  to  our  memories  of 


the  processes  and  activities  we  use  in  order  to  achieve 


our  goals  -  that  is,  the  mental  states  we  re-create 


that  once  solved  problems  in  the  past.  The  problems 


we  have  to  solve  change  with  time,  so  we  must  adapt 


our  old  memories  to  our  present  goals'  (Minsky,  iyBb:B7j 


'Level-band'  with  the  added  idea  of  'levels'  transforms 


a  way  of  describing  things  into  a  way  of  using  them 


to  do  thin  gs. 


Minsky  shows  the  idea  of  level  relates  to  the  many 
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ways  a  human  thinks.  He  goes  on  with  the  discussions 
by  examining  the  fringes  of  the  levels.  If  the  level 
of  detail  about  an  object  is  too  detailed  (lower-band) , 
then  it  will  prove  to  be  too  difficult  to  relate  the 
ideas  to  new  situations.  Consequently,  if  the  level 
of  detail  is  too  lax  (upper-band)  then  the  goals  will 
not  be  within  reach  of  the  situation. 


K-Una  attached  to  many  aganta.  K-tina  attachad  to  thraa  K-finaa. 

figure  3-4.  K-Line  Attachments.  (Minsky,  1980:09) 

Another  function  of  K-lines  is  their  ability  to 
tie  to  other  K-lines.  (See  figure  3-4b)  This  saves 
the  mind  from  having  to  connect  K-line  to  ail  pertinent 
agents.  But  there  is  a  cost  in  making  these  connections 
*Our  trick  of  connecting  new  K-lines  to  old  ones  will 
not  recapture  so  many  of  the  scene's  precise,  perceptual 
details.  Instead,  the  kinds  of  mental  states  that  this 
'hierarchal '  type  of  memory  produces  will  be  based  more 
on  stereotypes  and  default  assumptions  that  on  actual 
perceptions.  Speci f ical iy ,  you  will  tend  to  remember 

b« 


only  what  you  recognized  at  the  time.  bo  something 
is  lost  -  but  there's  a  gain  in  exchange.  These  K-lme 
memory-trees'  (see  figure  3-b)  looses  certain  Jcinds 
of  details,  but  they  retain  more  traces  of  the  origins 
of  our  ideas.  ...the  structured  memories  will  be  much 
more  easily  adapted  to  new  situations.'  (Minsky,  iyutJ:By) 


Figure  a-b.  Memory  Trees.  (Minsky,  iUBbiyo; 
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figure  3-0.  (Minsky ,  iytiO:yn 


As  an  individual  isarns ,  three  things  occur:  1) 

The  mind's  Knowledge-trees  bscoms  mors  detailed  by  tying 
mors  agsnts  to  various  K-ilnss.  These  complsx  trsss 
bscomss  a  'society'.  2)  Mors  know! sdgs- trsss  ars  crsatsd 
and  storsd  by  tbs  mind.  3)  With  mors  trsss  and  mors 
dstaiis,  mors  K-iines  intsr-connsct  tbs  socistiss. 

This  bscomss  tbs  uitimats  in  isarning  tbsory.  Tbs  bsttsr 
an  individual  crsatss  and  links  tbs  socistiss  tbs  mors 
capability  bs  will  bavs  to  solvs  problsm  and  rscail 
dsscr iptions . 

3.22  Schema  Tbsory: 

Tbs  basic  hypothesis  underlying  schema  is  that 
'changes  in  tbs  knowledge  bass  can  produce  sophisticated 
cognitive  performance'  ((ilasser ,  iyti4:y*n. 

This  bypotbssis  initiated  many  research  efforts. 


Krom  several  studies  comes  the  recommendation  that  an 


important  focus  for  understanding  sxpsrt  thinking  and 
problem  solving  is  investigation  of  the  characteristics 
and  influence  of  organized  knowledge  structures  acquired 
over  long  periods  of  learning  and  experience*  (Uiasser, 
1BB4:VB).  This  recommendation  was  also  made  by  Minsky 
and  Fapert.  in  the  mid  70'i,  the  emphasis  of  artificial 
intelligence  changed  from  a  power-based  strategy  of 
thinking  to  a  knowledge- based  strategy.  This  change 
was  supported  by  the  theory  that  intelligence  was  a 
function  of  knowledge  organization.  A  very  intelligent 
person  might  be  that  way  because  of  specific  local  features 
of  his  knowledge  organizing  rather  than  because  of  global 
qualities  of  his  thinking'  UJiasser,  1VB4:»BJ. 

Schema  theory  is  based  on  the  idea  that  the  human 
mind  stores  knowledge  in  structures.  If  the  mind  does 
store  knowledge  in  this  manner,  then  there  ought  to 
be  ways  to  determine  the  organizational  patterns  and 
represent  them  to  other  individuals.  'Schema  theory 
attempts  to  describe  how  acquired  knowledge  is  organized 
and  represented  and  how  such  cognitive  structures  facilitate 
the  use  of  knowledge  in  particular  ways. 

A  schema  is  conceived  of  as  a  modifiable  information 
structure  that  represents  generic  concepts  stored  in 
memory.  Schemata  represent  knowledge  that  we  experience 
interrelationships  between  objects,  situations,  events, 
and  sequences  of  events  that  normally  occur.  in  this 


sense ,  schemata  »•  prototypes  in  memory  of  frequently 
experienced  situations  that  individuals  use  to  interpret 
instances  of  related  knowledge'  Uilasser  iua4:l00). 

Using  the  schema  theory,  educational  researchers 
have  applied  the  ideas  to  learning  and  teaching.  To 
apply  this  theory  to  teaching  required  the  development 
of  several  important  teaching  principles.  'hirst,  one 
must  understand  an  individual's  current  state  of  knowledge 
in  a  domain  related  to  the  subject  matter  to  be  learned, 
and  within  which  thinking  skills  are  to  be  exercised. 

Second,  a  'pedagogical  theory'  can  be  specified  by  the 
teacher  that  is  different  from,  but  close  to.  the  theory 
held  by  the  learner.  Then  third,  in  the  context  of 
this  pedagogical  theory,  students  can  test,  evaluate, 
and  modify  their  current  theory  so  that  some  resolution 
between  the  two  is  arrived  at'  Uilasser  lWtt4:i0i). 

The  basic  pedagogy  for  schema  is  to  develop  lessons 
and  experiences  which  enable  learners  to  build,  test, 
modify,  and  retest  these  cognitive  structures.  This 
process  relys  very  heavily  on  the  ability  to  capture 
the  student’s  structure.  Thus ,  learning,  or  knowledge 
acquisition,  is  the  development  of  these  structures 
in  the  human  mind. 

3 . 23  Ausubel's  Theory  of  education 

The  two  previous  theories  set  the  scene  for  a  discussion 


of  Ausubel's  theory  of  cognitive  learning.  baaed  on 


aimiiar  underatandinga  of  tne  human  mind  propoaed  by 
Minsky  and  (iiasser,  Auaubei  developed  tne  cognitive 
theory  of  learning.  There  are  five  major  componenta 
to  this  theory  and  all  are  liated  in  figure  b-7. 

3  •  24  Supporting  Folnte  of  View; 

The  above  deacription  of  how  the  human  atorea 
information  la  aupported  by  an  obaervation  of  Koger 
Schank  who  ia  working  in  the  artificial  intelligence 
field.  He  ia  explaining  the  idea  that  concepta  muat 
be  linked  to  prevloua  knowledge.  'We  underatand  what 
we  read  by  adding  it  to  what  we  already  know;  a  new 
meaning  ia  aiwaya  a  product  of  a  prevloua  meaning. 
Underatandlng  a  sentence  involves  all  the  knowledge 
we  have  so  far  acquired  about  what  goes  on  in  the  world. 

The  more  knowledge  we  have  about  the  world,  the  more 
experiences  we  have  had,  the  better  equipped  we  are 
to  find  possible  meanings  for  whatever  sentence,  paragraph, 
poem,  or  story  might  come  our  way.  Language  is  not 
in  itself  knowledge,  but  it  is  a  medium  for  expressing 
and  organizing  what  we  think  we  know,  which  ia  really 
only  what  we  believe  or  feel  at  a  given  time.  When 
we  are  saying  to  ourselves,  whoever  wrote  this  sentence 
has  some  knowledge  and  this  sentence  must  be  his  or 


at  »a.*ti. 


Ausubel’s  Cognitive  Theory  of  Learning 


Key  Concepts 


Meaningful  Learning 

A  learner  consciously  and  deliberately  links  new 
knowledge  with  relevant  concepts  s/he  already  knows. 


Kots  Learning 

That  which  occurs  when  a  learner  makes  no  deliberate 
effort  to  relate  new  knowledge  to  concepts  the  learner 
already  has. 


Hierarchically  Organized 

Cognitive  structures  have  more  inclusive,  more  general 
concepts  an  prepositions  superordinate  to  less  inclusive, 
more  specific  concepts  and  proposi tions . 


Progressive  Differentiation 

Concepts  m  cognitive  structures  undergo  progressive 
differentiation'  wherein  greater  inclusiveness  and  greater 
specificity  of  regularities  in  objects  or  events  are 
discerned  and  more  propositional  linkages  with  other 
related  concepts  are  recognized. 


intekrative  Reconciliation 

This  occurs  when  two  or  more  concepts  are  recognized 
as  relatable  in  new  propositional  meanings  and/or  conflicting 
meanings  of  concepts  resolved. 


figure  J  -  7 .  Ausubei's  Key  Concepts.  (Uowin,  lya:/) 


her  attempt  to  communicate  this  knowledge’  (Shank, 


1  y  84 :  17)  . 


Shank’s  second  observation  deals  with  the  definition 


of  events  or  objects.  He  looks  at  concepts  as  linked 


by  action  verbs.  using  this  definition  each  concept 


gains  it's  identity  by  the  combination  of  actions  used 


to  describe  it. 
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'We  tend  to  see  the  world  in  ttrma  of  the  tvtnt a 
that  take  place  in  it.  These  «v«nts  usually  involve  one 
or  more  action#,  which  we  describe  using  the  many  verbs 
in  our  language.  We  earn  think  of  concepts  which  don't  involve 
actions,  such  as  a  fine  spring  day,  or  a  rock,  or  a  fire 
hydrant.  it's  easy  to  say  that  a  rock  doesn't  perform  actions 
because  it  just  sits  there  and  doesn't  move.  But  we  have 
to  stop  and  remember  that  the  descriptions  'just  sitting 
there'  and  'not  moving'  both  refer  to  actions. 

it  is  extremely  difficult  to  describe  an  event  without 
describing  actions  as  well.  we  can  say  the  words  'rock' 
and  'fire  hydrant'.  But  somehow  the  word  'rock  '  itself 
doesn't  tell  us  much  about  rocks.  We  have  to  use  other 
words.  A  fire  hydrant  means  the  set  of  actions  that  are 
called  up  when  there  is  a  fire.  it  refers,  in  an  implicit 
way,  to  the  need  to  stop  fires  from  destroying  objects  by 
soaking  those  objects  with  water.  if  we  want  to  describe 
a  fire  hydrant  in  a  useful  way,  we  must  do  so  almost  entirely 
in  terms  of  actions.  What  can  one  do  with  a  fire  hydrant7 
What  comes  out  of  a  fire  hydrant?  What's  it  made  of?  What's 
a  fire7  The  actions  involved  in  the  concept  of  a  fire  hydrant 
are  discrete  and  unique  in  that  they  differ  from  those  involved 
in  the  concept  of  a  telephone  or  and  electric  drill.  (Shank. 

1 W84 : WO ) 

Another  observation  about  the  function  ot  the  mind 
comes  from  professor  O.Bob  Uowin.  As  an  educational  researcher, 
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d«t«rmimng  how  the  mind  functions  is  key  to  being  able 
to  develop  sffsctivs  teaching/ itarning  methods.  He  also 
supports  these  theories  as  reflected  in  tf>«  following  obser¬ 
vations  . 

'Our  minds  seem  to  work  * hierarchical iy ’  as  a  mosaic 
of  interrelated  concepts,  but  instruction  is  necessarily 
linear  in  form.  We  must  present  knowledge  segment  A,  then 
segment  b,  then  segment  0  and  so  on.  Concept  maps  can  neip 
us  to  organize  tne  whole  set  of  concept-propositional  relation¬ 
ships  we  wish  to  present,  but  then  we  must  still  reduce 
this  organization  to  some  sequence  of  topic  A,  topic  b, 
topic  C,  and  so  on.  Concept  maps  do  not  specify  the  exact 
sequence  for  presentation,  but  they  do  show  hierarchies 
of  ideas  and  thus  suggest  psychologically  valid  sequences 
(Uowin ,  !Vb2 : 4 . 4) . 

3.30  Why  Concept  Mapping-': 
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3.31  The  power  of  Concept  Mapping: 

Ausubels  Dictum:  The  most  important  single 
factor  influencing  learning  is  what  the  learner 
already  knows.  Ascertain  this  and  teach  him  accor¬ 
dingly  KJowln ,  IVbkiik;. 


in  order  to  get  at  what  the  student  knows,  a  tool 
or  device  had  to  be  developed.  This  tool  had  to  be  simpie 
and  functional  in  ascertaining  what  tne  learner  knows. 
Ausubel  presented  the  idea  of  cognitive  maps.  (Jowin  ana 
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Novak  continued  this  i;n«  ol  riuoning  And  implemented  concept 
mapping  into  a  vAPiety  of  teaching  ArenAi .  They  found  concept 
mapping  to  be  An  invAiuAble  tool  for  determining  what  a 
learner  knows.  'Concept  mapping  is  An  educAtionAi  tool 
that  bAS  been  developed  specif iCAlly  to  tap  into  a  learner  s 
cognitive  structure  And  to  externAlize  for  botb  tne  learner 
And  teACber  to  see  what  tbe  leerner  Aireedy  knows 
Uiowin ,  IVU2:12). 

Uowin  contrested  tbe  benefits  of  tbe  concept  map 
inst  tbe  outline.  he  found  two  distinct  differences. 

Kirst,  good  concept  steps  show  key  concepts  end  propositions 
in  very  explicit  end  concise  lenguege.  Second,  good  concept 
steps  ere  concise  end  bence  show  tbe  key  ldeetionei  reietionsmp 
in  a  simple  visual  fesbion  Uiowin,  1VU2:4.4J. 


3.32  Applying  Concept  Mapping  to  tbe  Problem: 

Trensieting  concept  stepping  from  en  educetionei  setting 
to  one  of  problem  solving  or  decision  steking  is  not  as  drastic 
as  it  might  seem  At  first.  The  expert  repleces  the  teecher . 

The  USS  designer  becostes  the  leerner.  hut  the  concept  map 
teps  tbe  cognitive  structure  of  the  teecher  msteed  ot  tne 
leerner.  This  creetes  a  step  of  the  Knowledge  structure 
of  the  expert.  it  can  then  be  used  to  translate  and  negotiate 
meaning  to  the  USS  designer.  Unce  tne  USS  designer  understands 
the  problem  and  the  process  he  uses  the  information  to  develop 
the  decision  aid.  The  map  can  also  become  a  record  ot  una*r- 
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standing  lor  luturs  rtlarmc*. 


bass d  on  tas  tnsonss  prsssntsd  by  Minsky,  (iiass 
and  Ausubsl ,  and  tns  rsssarcb  t indings  Irom  sducational 
rsssarcn  sflorts,  concspt  maps  can  dspict  tns  sxpsrt  s  knowisdgs 
bass.  Tns  K-iins  tnsory  tsils  us  tnat  tns  knowisdgs  organization 
ol  a  problso  win  bs  tns  agsnts  ussd  in  dslining  and  solving 
it.  Scnsma  tnsory  also  supports  tms  conjscturs  wnsn  appiisa 
to  probisn  solving.  Tns  conclusion  is  tnat  concspt  maps 
crsatsd  by  tns  sxpsrt  capturs  tns  ksy  concspts  ol  tns  probism 
and/or  tns  sismsnts  ol  tns  dscision  procsss  ussd  by  tns 
sxpsrt . 

Ksasons  lor  Sslscting  Concspt  Mapping: 

Tbsrs  is  ons  final  qusstion  to  ask.  is  tnsrs  anotnsr 
tool  tnat  can  capturs  tns  sxpsrt  s  sxpsrtiss  as  sllsctivsiy 
as  concspt  mapping'  Ths  only  tools  avaiiabls  ars  tns  knowisdgs 
rsprsssntat i on  systsms  discusssd  abovs .  Tbsss  ars  gsnsraiiy 
not  appropnats  bscauss  tnsy  ars  rsprsssntat  1  on  systsms 
and  not  acquisition  systsms.  It  is  possibis  to  structurs 
SHU*  into  concspt  mapping  format  ,  but  an  altsrsd  t>  mm*  would 
bscoms  concspt  mapping. 

Tbs  otnsr  knowisdgs  rsprsssntat 1  on  modsis  navs  ossn 

ussd  in  data  bass  systsm  to  snow  rs  1  at  1  omh  1  ps  bstwssn  data 

sismsnts.  l'hsy  ars  vsry  rsstrictivs  bscauss  of  tns  nssd 

to  intsract  with  machinsi .  Thsis  modsis  do  not  navs  tns  I 

■ 

built  in  flexibility  and  nisrarcnical  functions  of  concspt 


mapping.  Tnui ,  the  process  would  loss  semantic  relativism 
and  ordinate  meanings.  kor  these  reasons  concept  mapping 
is  anticipated  to  be  an  Ideal  tool  f or  capturing  knowledge 
from  an  expert. 

3 . 40  Conclusion : 

if  tbe  expert  is  really  the  expert  in  solving  the 
problem,  then  capturing  the  specific  problem  a  agents 
^concepts;  and  their  appropriate  K-lines  llinkSJ  would 
capture  the  definition  and  decision  process  elements.  with 
this  twist  in  its  use.  concept  mapping  becomes  the  basic 
tool  for  acquiring  knowledge  from  an  expert. 

The  next  chapter  teaches  how  to  do  concept  mapping 
and  explains  some  of  the  techniques  required  in  holding 
a  knowledge  acquisition  interview. 


Chapter  4 


The  Concept  Mapping  1'iccniqu* 

4.00  introduction : 

Learning  tne  concept  mapping  teennique  is  just 
like  learning  any  otQer  null .  The  student  must  start 
by  learning  tfie  terms  and  basic  rules  to  tne  procedure. 
Then  s/he  must  practice,  practice,  and  practice  some 
more.  Tbe  skill  of  concept  sapping  nas  relatively  tew 
terms  and  rules.  it  is  a  simple,  functional  tool  tnat 
can  be  applied  to  a  variety  of  learning  or  knowledge 
acquisition  requirements. 

Concept  mapping  comes  from  tne  field  of  cognitive 
education.  A  teacner  who  believes  in  tne  cognitive 
structuring  phenomena  of  tne  mind  win  use  concept  mapping 
to  introduce  students  to  new  concepts.  The  teennique 
is  relatively  new  yet  it  is  basic  to  education.  An 
ot  tbe  examples  in  this  chapter  are  from  tne  autner  a 
background  in  applying  concept  mapping  wmie  teaching 

This  chapter  introduces  tne  sxius  of  concept  mapping 
and  conducting  the  concept  mapping  interview  i he  first 
parts  ot  tnis  chapter  follow  Uowin  s  strategy  lor  mtrodur 
concept  mapping  to  learners  figures  4-.  and  4  *  .is*, 

aii  the  steps  in  .jo  win  s  strategy  :nis  .  esaon  .a  i  r. 
two  parts  Ihe  first  part  .ntroducea  and  defines  the 
ter  ms  o!  concept  ma  p  p i n  g  ihe  ma in  purpose  :~r  *  h . s 


Mi  can  UtM  tf  nM  n  tha  kUcttMN  ir  MirtnJ  ynje ctar  ala«  • 
list  rf  MUa  nerde  far  ebjaete  aad  Mrtir  llat  Ik  mtti.  Far 
mkUi  ekjnet  ear  id  K#t  hat  car,  Oat,  chair,  tree .  eland,  keek,  aad 
■  intiKia  anU  be:  mislay,  fin  1*0.  Mkla|,  chlaklay,  tkarin, 
birthday  farcy.  M  chlldrm  tf  they  eaa  laalka  ka*  the  We  Uaca  differ. 
M  tka  cblldrm  Ca  danerlbe  rial  they  tklak  af  «kaa  (bay  kaar  tka  ward 
car,  4a«,  Me.  data  ckaa  raaagatsa  tkat  rr«a  chaagi  «a  aaa  tha  caaa  nerds, 
aacfc  af  aa  ny  tklak  af  eeaethlay  a  little  dlffernc.  These  aaaeal  lngee 
aa  fcaaa  far  tarda  ara  cat  c entente;  latradne  tka  nerd  "conceit”, 
kayeac  actlaltlaa  la  ft.  nlny  araac  ear 4a.  Ayala,  fatal  aat  tka  difference 
aa  all  Wane  ta  mm  natal  lanym  ar  eeoccfta  af  aanta.  Tea  aay  ant  ta 
nyyeet  at  tkla  fatal  tkat  aaa  raaaaa  aa  have  treadle  aa4erataa4tay  each 
ackar  aaaattaaa  ta  tkat  aar  « aat  aft  a  an  Barer  delta  ldaatlcal  area  though 
aa  kaae  tka  a aaa  tarda.  dat-de  an  lake  la  far  eaactfti,  kat  each  af  n  auat 
attain  aar  aaa  aantaya  far  aarda. 

■a  llat  tarda  aaak  m  an,  tkara ,  tha,  ta,  than ,  tick,  ate.  Aak  children 
uhec  man  ta  their  adada  da  they  Hear  nek  af  tkaaa  ear  da.  Thera  ara  not 
nnn«  tarda  i  ta  call  thee  1  lwhicy  tarda  nd  n  an  tkaaa  la  ayaaklay  aad 
nr  It  lay.  Llaklay  tarda  an  aaad  tayatkar  tick  caaeaft  aarda  ta  eentnet 


Ft  near  naan  ara  nt  eaecayc  aarda  kat  rather  tn  af  aaaclflc  yaafla,  ataata 
flnn.  ar  ak)nta.  On  aaaa  emaaylm  aad  half  cklldraa  ta  an  tha 
diet  lac  t  let  kettaaa  ldcli  far  nnlerltln  la  evnta  ar  abjaeta  aa  cntrncad 
ta  eynlflc  etnea  ar  ebjnta  ar  frayer  ten. 

Inlay  t«e  case  eye  aarda  n  the  beard  aad  llekla  |  aarda,  cantnct  a  faa 
akarc  antann  ta  lllmcnte  kat  caacayt  tarda  fin  llaklay  aarda  an  used 
by  htaan  ta  eeaeay  aaaalay.  fl  i  I  --  naald  ka:  lha  day  la  mating,  Tkara 
an  claade  aad  thunder .  etc. 

late  tka  codetta  can  tract  a  fn  abart  antaaen  af  tbalr  aaa  aad  Identify 
tka  caaceet  tarda ,  nil  akacker  each  ta  n  abject  ar  aaaac,  aad  alee  Identify 
tka  llaklay  aarda. 

If  yea  been  billayeel  ckUdrn  la  tha  clna,  hare  than  free  ant  eaaa  foreign 
aarda  tkat  label  tka  nan  rente  ar  adjects.  lalf  tha  cklldraa  recoyalia 
tkat  lanya ye  dan  aat  ada  tka  aaaeeyt ;  It  akly  earns  n  tha  label  ta  aaa 
far  tka  caacayt.  If  ta  Inn  tarda  kat  fall  ta  lean  that  kind  af 
ryy  Verity  la  akjacea  ar  mate  tka  aarda  raynaan ,  aa  kata  tat  learned 


leered  tea  caaa  chert  bat  nfndllar  tarda  ta  tha  clean  etch  n:  dire, 
tana,  tile  Than  an  aarda  that  ctaad  far  tan  canceyte  they  already 
heat,  kat  they  hate  aaaaakat  eyeclal  aanlaye.  Bely  the  children  eaa  that 
aaecayca  da  aat  hate  rigid .  find  nnlaya,  hat  tha  aanlaye  cn  grot  and 


Chteec  e  etc  t  let  af  a  tent  bank  (ana  faya  ta  enfflcln:)  nd  duyllcate  coy  lee 
far  ckUdrn.  Ckana  a  reed  lay  yaaeaya  that  caataya  a  definite  nasaga. 

An  a  clean,  aak  that  ta  read  tka  yneaye  nd  Identify  key  coecefca.  Detally 
10  te  N  relocate  canceyte  till  be  feted  la  a  clayle  f aye  ef  teat  aaterlel. 
AJUa  hen  the  children  ana  can  llaklay  tarda  aad  caacayt  tarda  that  ara 
lane  layer  tent  ta  tha  "clary  lm" 


f i Juro  4  - i 


uiowin,  iVtt'i:  Table  2.31 


V 


g— — t  Hwti—  hCtlTltiec 

1.  Solace  a  particularly  aaaaiagfel  pcragrepk  ar  tue  iron  a  tart  ar  ether 
printed  notarial.  lava  the  tteOeota  nai  tha  taat  aaa  talact  tha  "kay 
caaa  apt  a,"  that  U  cheae  taaaapta  aacacaarp  (ar  uaOecetanPing  tha  aaaaiag 
ai  tha  taat.  Uat  thaaa  caaaapta  aa  tha  beard  (ar  ooerhcaP  projector)  a a 
thap  ara  identified.  «*•  Olaceaa  with  tha  atuOaaca  <*ich  eaaaapt  ia  tha 
aaat  taper taat.  aaat  laelaaiaa  IPee  ia  tha  taat. 

2.  Pat  tha  "aaat  laelaaiaa”  eaaaapt  at  tha  M  ai  a  aaa  liat  ai  *raah 
ordered”  eaacapt.  Uat  tha  aaat  "aaat  |aaeral",”aaat  laelaaiaa  coaccpt,” 
necking  through  tha  iirat  liat  aatil  all  caacapta  ara  *raak  ordered.” 

Thera  will  aat  ataapa  he  ipraaaaat  aaaap  the  ituOaata  oa  tha  ordering 

hat  aaaallp  aalp  a  iea  aajer  Oifferaecaa  la  raakiap  at  tha  caacapta  erica, 
aai  thia  ia  OK;  it  capgaate  that  thara  aap  ha  aara  thaa  aaa  aap  ta  caa  tha 
aaaaiap  ai  tha  taat  calactiaa. 

3.  Pea  hapia  caaatractiap  a  coacept  aap,  aalap  tha  raak  ordered  liat  aa  a  paiPc 
ia  hailPiap  tha  eaaaapt  hiararckp.  Haaa  acaPaata  help  la  chaaalap  paaP 

1 1  ok  lap  war  Pa  ta  (ara  tha  aroaaaitlaaa  chaa  hp  tha  11  aaa  oa  tha  aap.  Oaa 
pood  aap  ta  praetlca  aap  aaklap  la  ta  haaa  acudenta  write  concept  aorta 
aap  linking  aria  oa  paper  ractanplaa,  aaP  thaa  thap  caa  raarraapa  thaaa 

_  aa  thap  pet  aaa  laalahta  aa  tha  aaa  oreanltatloa.  (Sea  fipora  2.*.) 

*.  Ho*  look  (ar  "croaa liaka"  becueea  caacapta  ia  oaa  eectloa  ai  tha  aap  aaP 
caacapta  la  aaothar  pact  ai  tha  eaaaapt  "tree."  lava  ataPoata  help  to 
chooaa  liafclap  war Pa  (ar  tha  croaa  l lake. 

3.  Heat  “iirat  aiiort”  aapa  haaa  poor  apoHatrp  or  aeM  concept  cluetera. 

poorlp  locataP  ralatiao  to  other  aore  elaaalp  ralataP  caacapta  or  cloatar* 
ai  caacapta.  tec ana tract  tha  aap  If  thia  oomIP  ha  helpful.  Point  oat  ta 
a  rap one a  that  ac  laaat  aaa  aaP  a aaa  tinea  too  or  three  reconstruction*  of 
a  aap  are  aeoPoP  ta  ■ how  a  good  repreeaetatioa  at  propooitlaaal  aaaalaga 
aa  thap  oaParacaaP  thaa. 

i.  Macuaa  cha  coacept  aap  acoriag  criteria  ia  Table  2.*  aap  “acore*  the 

roe* apt  aap  c oaa true tap.  Poiat  oat  poaaibla  atructural  cheater  that  eight 
taprrtwi  tha  aoeeieg  ai  the  aep,  aaP  par hep*  tha  aap ' a  acara. 

7.  haaa  tha  ataPaac  aalact  a  aactioa  of  taat  ar  ocher  aatarial  aaP  repeat  aa 
their  aee  (or  ia  (roopa  o(  2  or  3)  reap*  1-P. 

IteOeet  eonacroctaP  aepa  can  ha  praeonteP  to  the  clea*  aa  the  blackboard  ar 
oaarhaaP  projector.  Ip  “reading”  tha  aap,  it  ahoalP  he  clear  to  other 
ataPoata  ia  the  claaa  what  tha  teat  aactioa  wo*  about . 

7 ■  leao  etuPonta  con* truer  a  concept  aap  far  IPaaa  iaparteot  la  a  hobbp,  apart, 
or  apocial  iataraat  area  thap  haw*.  Thaa*  eight  ha  poataP  aroanP  tha  rooa 
aap  infernal  Piacuaaien  ire  nr  a  gap . 

14.  lacorporata  on*  or  two  concept  napping  “auaationa”  ia  poor  aaat  teat  ta 
lllaatrata  Chat  caa* apt  aappiag  ia  a  ratio  aralaatioa  precoPer*  chat 
Ian cade  hard  thinking  aap  can  illaacrato  enPerataaPing  of  the  aebjact 
aat tar. 


((iowin,  i.yB2:  Table  2.3) 
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lesson  is  to  prepare  the  learner  for  tne  actual  concept 


mapping  activity.  The  second  lesson  steps  a  student 
through  his/her  first  concept  map.  After  this  brief 
introduction  to  concept  mapping,  the  student  is  encouraged 
to  practice  as  much  as  possible. 

Once  the  student  has  mastered  concept  mapping  s/he 
is  ready  for  the  interviewing  session.  The  remainder 
of  the  chapter  explains  the  process  used  to  concept 
map  the  problem  definition  and  decision  process.  Several 
suggestions  and  ruies-of-thumb  are  given.  These  sugges¬ 
tions  are  based  on  personal  experiences  of  over  100 
hours  of  interviews  and  literature  reviews  of  the  inter¬ 
viewing  process.  This  portion  of  the  chapter  is  not 
in  a  lesson  format,  but  will  perform  as  teaching  forum. 

4.10  Learning  How  to  Concept  Map: 

The  following  sections  introduce  the  two  lesson 
plans.  These  lesson  plans  are  generically  designed 
for  any  person  interested  in  learning  the  skill. 

4.11  Preparing  for  Concept  Mapping; 

Attachment  A  is  a  self-paced  lesson  plan  for  any 
student  wanting  to  learn  the  basics  of  concept  mapping. 
Lesson  A  introduces  the  student  to  the  following  terms: 

Objects  Events  Concepts 


7  a 


Linking  Words 


Key  Concepts 


atft  .U'.U  lit  «.>  «.*  ».» 


The  last  step  in  the  process  is  managing  the  interview. 


This  section  is  designed  specifically  for  the  OSS  designer 
who  will  be  using  the  concept  mapping  technique  in  defining 
the  problem  and  identifying  kernels  of  the  decision 
process . 

4.21  Scheduling  the  Interview: 

The  most  important  part  of  scheduling  the  interview 
is  identifying  and  choosing  the  problem  solver.  Although 
you  may  take  on  the  role  of  problem  solver,  in  most 
cases  this  task  will  be  handled  by  another  individual: 
someone  who  by  experience  or  position  has  the  unique 
knowledge  necessary  to  solve  the  problem  or  make  the 
decision.  This  person  is  the  primary  user  that  the 
DSS  is  intended  for.  This  is  an  'expert'.  An  expert 
is  one  of  only  a  few  persons  who  has  special  or  unique 
knowledge.  *  ay  an  expert  we  usually  mean  a  person  who 
knows  how  to  define  problems  and  solve  them.  He  knows 
what  facts  or  data  to  collect  and  investigate,  he  knows 
what  rules  to  use,  and  he  knows  how  to  make  inferences’ 
tfasdi .  iyas: 12) . 

Selecting  this  person  requires  an  evaluation. 

Kirst,  learn  as  much  as  possible  about  the  problem  itself. 
Are  there  people  currently  solving  this  or  similar  problems? 
If  so,  who  is  considered  the  best  at  solving  the  problem7 
Next  make  a  list  of  possible  experts  m  the  problem 


domain.  Than  avaiuate  the  list.  Kara  are  soma  criteria 
that  may  ba  used  in  evaluating  the  list  of  experts. 

1)  Who  do  you  as  the  Das  designer  have  access  to? 

2)  What  are  the  costs  involved? 

(e.g.  Travel,  Consultation  Kees ,  etc.) 

3)  What  are  the  available  resources? 

Once  the  experts  have  been  selected,  they  need 
to  be  prepared  for  the  interview.  To  prepare  the  expert 
for  the  concept  mapping  interview,  hold  a  meeting  with 
all  of  the  experts  at  one  time,  if  possible.  At  this 
meeting  brief  the  experts  on  the  problem  that  you  are 
facing  in  trying  to  capture  the  definition  of  the  problem 
and  identification  of  the  decision  process.  inform 
the  experts  on  the  needs,  goals  and  methods  used  in 
the  upcoming  interview.  This  meeting  sets  the  stage, 
it  gives  the  purpose  for  the  interview  and  tells  the 
expert  what  role  s/he  is  to  play. 

The  experts  are  better  able  to  organize  and  communica 
their  cognitive  structures  on  a  subject  if  they  Know 
exactly  what  is  needed  and  what  are  the  goals.  Experts 
need  to  know  a  variety  of  different  types  of  information. 
Some  of  the  questions  to  be  answered  for  the  expert 
in  this  briefing  are: 

1)  What  kind  of  information  is  being  sought? 

2J  Which  problem  space  are  they  to  concentrate  on7 

3)  What  is  the  process  being  used  m  the  interview7 


4)  How  much  time  is  needed  from  eacb  of  them? 


5 )  What  is  tne  information  going  to  be  used  for? 

Answering  these  questions  bsfors  attempting  the  interview 
concentrates  tbe  efforts  of  tbe  expert  on  tbe  problem 
ratber  than  on  tbe  process . 

This  initial  briefing  also  saves  time.  As  Hden 
points  out  tbe  first  interviews  rarely  have  content. 

He  cites  tbe  time  is  taicen  in  pleasantries,  spouting 
' mother bood ' ,  other  general  things,  finding  out  ’What 
tbe  bell's  going  on  round  here*,  etc.  Cbden,  lyBSrOi^J. 

To  illustrate  this  point,  all  of  tbe  KAAl'  experts 
were  briefed  on  tbe  purpose  and  process  of  the  interviews. 
After  introductions  they  were  shown  tbe  basics  of  tbe 
concept  mapping  technique.  This  was  just  a  general 
overview  of  tbe  terms  and  an  example  of  bow  a  concept 
map  is  built.  Once  they  felt  reasonably  comfortable 
with  tbe  process ,  they  were  asked  to  concentrate  on 
their  definition  of  KAAy  and  what  they  perceive  tbe 
decision  process  to  be.  Kinail y,  they  were  told  what 
tbe  maps  would  be  used  for.  They  were  now  ready  to 
be  interviewed. 

Tbe  last  thing  to  do  at  this  initial  briefing  is 
make  tbe  appointments.  Tbe  time  available  and  tbe  desired 
extent  of  detail  in  tbe  maps,  determines  tbe  number 
of  interview  appointments  made  with  each  expert. 


(ienerally,  three  one-on-one  interviews  are  best. 

Make  individual  appointments  witn  eacn  of  tne  experts. 

Co  not  attempt  to  interview  two  or  more  experts  at  the 
same  time.  Experience  has  shown  that  one  of  the  experts 
will  do  the  majority  of  the  talking  while  the  other 
just  agrees.  Interviewing  two  or  more  experts  at  the 
same  time  does  not  capture  the  multiple  understandings 
that  each  has . 

The  first  two  interviews  need  to  be  relatively 
close  together  in  time.  The  first  concentrates  on  the 
definition  of  the  problem  while  the  second  captures 
the  elements  of  the  decision  process. 

The  third  interview  session  should  have  a  considerable 
separation  in  time  from  the  first  sessions.  A  good 
separation  would  be  anywhere  from  two  to  six  weeks. 

A  shorter  separation  doesn't  allow  the  expert's  perceptions 
to  change  very  much.  Separations  longer  than  six  weeks 
generally  are  not  suitable  for  either  the  expert  or 
the  project.  This  separation  enables  the  expert  to 
further  think  about  the  problem.  As  has  been  observed 
in  other  concept  mapping  exercises,  people  change  their 
minds.  Perceptions  change  because  new  experiences  alter 
old  cognitive  structures.  This  is  the  natural  process 
of  learning  at  work.  There  is  more  discussion  about 
the  benefits  associated  with  changes  m  perception  in 


Chapter  b. 


The  purpose  of  the  third  inttrvitw  is  to  review 
the  maps  that  were  constructed  in  the  previous  sessions. 

The  expert  is  given  complete  freedom  to  check  over  the 
map  and  ensure  that  it  still  reflects  his  perception 
of  the  issue.  If  s/he  has  changed  his/her  view  of  the 
problem  create  the  new  or  changed  portion (s;  of  the 
concept  map.  Then,  have  the  expert  tie  the  new  clusters 
to  the  old  maps. 

kach  of  the  above  interviews  takes  about  an  hour. 

This  is  about  the  limit  any  expert  or  interviewer  will 
be  able  to  fully  concentrate.  If  the  time  resource 
requires  back-to-back  interviews,  breaks  are  a  necessity. 

Interviewers  have  limits.  it  is  advised  to  schedule 
no  more  than  four  to  six  interviews  per  day.  This  is 
also  recommended  by  (Jowin;  'four  to  six  per  day  is  ail 
that  most  people  can  handle  and  continue  to  be  alert, 
pleasant  and  thorough'  UJowin,  iyB2:7-i;j). 

4.22  Setting-up  the  Interviewing  Environment: 

The  preparation  of  the  room  and  keeping  records 
is  as  important  as  preparing  the  expert  for  the  interview. 
Kden  insists  on  a  particular  room  set  up  for  his  style 
of  cognitive  mapping.  in  his  review  of  a  session  evaluating 
the  problems  of  a  publishing  company,  he  cites  one  of 
the  nagging  problems  of  a  poor  environment. 

'The  day  was  disappointing.  The  hotel  provided 


rooms  tfitt  were  cluttartd  wit.fi  formal  furniture.  we 
had  raquaitad  three  rooms  in  whicn  eight  people  could 
work  in  cramped  conditions.  The  furniture  was  to  he 
easy  chairs.  What  we  finished  up  with  were  three  rooms 
of  vastly  different  sizes-all  too  big,  and  with  wans 
cluttered  with  wall  lights  and  fixed  pictures.  ...  because 
the  environment  was  not  as  intended,  it  took  me  longer 
to  generate  the  right  atmosphere  than  would  have  otherwise 
been  the  case'  (biden  lWbb:biO). 

following  are  a  few  of  the  rules-o f - thumb  for  setting 
up  the  interviewing  room  for  concept  mapping: 

1)  Select  a  room  where  you  and  the  expert  can  work 
the  entire  session  without  interruption  and  limited 
background  noise.  Heat,  light  and  ventilation  are  just 
as  important  as  noise  m  considering  the  room. 

2)  Obtain  a  chalkboard  or  dry  marker  board.  if 
these  are  not  available  use  flip  chart  paper  and  suitable 
markers . 


3)  Kecord  the  interviews.  Audio  tape  is  relatively 
cheap,  easy  to  manage ,  and  gives  a  record  of  the  interview 
in  complete  detail. 

4)  Operate  the  recording  machines  with  as  little 
interruption  as  possible.  11. e.  Use  120  minute  casse-tte 
tapes . ) 

5)  Obtain  comfortable  chairls)  and  a  table. 


bO 


4 . 2  0  Tft»  interview: 


The  interview  is  critical.  Conducted  and  managed 
properly,  tne  one  hour  eeeeion  can  return  a  county  ol 
information.  The  remainder  of  thia  diacuaaion  1a  a 
potpourri  of  suggestion*  and  rulea-of - tnumD .  figure 
4-d  liata  aome  laauea  to  conaider  anile  conducting  an 
interview.  tven  tnougn  tne  laauea  Hated  in  figure 
4-J  are  for  conducting  a  clinical  interview  tor  educational 
reaearen .  many  of  them  directly  apply. 

To  acquire  tne  moat  information  from  tne  expert, 
plan  tne  interview.  aatablian  tne  purpoae  for  tne  interview 
and  cnooae  appropriate  lead-off  queatlona  for  eacn  main 
topic.  If  the  interview  la  to  capture  tne  deciaion 
proceaa  ,  aak  a  lead-off  queation  tnat  direct*  tne  expert  a 
tninxing  toward*  tne  deciaion  proceaa.  for  example, 
tne  lead-off  queation  may  be:  How  would  you  aoive  tma 
problem' 

It  la  alao  important  to  prepare  aome  follow-up  questions. 
However,  don't  fall  into  tne  trap  of  having  to  a ax 
all  tne  queation*  on  my  liat  ayndrome .  This  become* 
boring  for  tne  expert  and  may  reduce  bn  openneai  toward 
tne  interview. 

WAIT!  After  asking  a  queation,  eapecially  a  lead-off 
queation,  wait.  Studies  anow  that  teachers  seldom  wait 
longer  than  2  seconds  after  asKing  a  question  before 
they  either  answer  it  themselves  or  restate  the  question. 

«  l 


iiiuai  of  interviewing 


i.  interviewing  mould  not  be  So:r»tic  l'etcning  Metnoa. 

i.  interviewers  must  oe  thoroughly  temiiier  with  the 
luo j ect  natter . 

0.  t'eraonaiity  (actor  are  important. 

4.  LISTEN  to  the  student. 

0  Wait  tor  an  answer1 
0 .  be  cordial . 

7.  Head  oil  dialogue  on  irrelevant  discussion. 

b.  1  don  t  snow  or  i  (orgot  answers  seldom  mean 

what  the  response  indicates. 

y.  Students  vary  widely  in  1 oquac l ousness . 

10.  Statements  revealing  (eeiings  are  signiricant. 

ii.  in  sequential  interviews,  it  can  he  neiptui  to  reter 
to  prior  interviews  and/or  relevant  intervening 

instruct  ions . 

11.  Use  the  student's  language  when  rephrasing  q  .estions 
or  probing  further. 

id .  Uo  not  force  your  logic  on  the  student. 

14.  fend  the  interview  on  a  positive  note. 

figure  4 - J .  issues  o!  Interviewing 
lUowin  ,  IVUU  :  1  d-  ibl 


Therefore  the  interviewer  must  be  extremely  cautious 
not  to  rush  the  expert.  It  is  going  to  taxe  the  expert 
some  time  to  recall  the  information  and  organize  it 
in  a  manner  that  s/he  can  communicate  it.  Keraember , 
you're  asxing  an  expert  to  do  one  of  the  most  complex 


i 
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•  xtrcuai  tor  tne  mind  to  tcconpiiin  jiv«  rum-  ntr 
Urn*  to  r«*pond 

LISTS*'  Attar  watting  tor  toe  response,  iux*  aura 
you  listen  ana  understand  what  taa  expert  is  saying 

Uon  t  be  atraid  to  rephrase  tne  expert  s  statements 
especially  it  you  don  t  see  tne  tying  r e i at  1 onsn i ps 
or  understand  tne  terms .  He  is  tne  expert  ana  you  are 
tne  learner.  it  a  concept  can  nave  more  tnan  one  name 
or  label  agree  on  tne  Best  laDei  as  tne  interview  progres 
sea.  Much  ol  tne  time,  more  tnan  one  laoel  can  oe  used 
to  represent  a  concept.  cnoose  one  and  maintain  it 
tnrougnout  tne  interview  unless  it  is  no-longer  tne 
agreed  laoe i . 

As  tne  expert  starts  to  give  tne  l n t ormat 1  on ,  draw 
tne  concept  map  on  tne  Ooard .  Cutting  tne  maps  on  tne 
board  allows  botn  tne  expert  and  tne  interviewer  to 
see  tne  map  and  discuss  the  concepts  together. 

write  i*  AST 1  Don't  let  tne  expert  thinx  he  has 
to  wait  on  you.  Encourage  him  to  talk  at  a  normal  rate. 
Hemember  you're  mapping  only  the  Key  concepts. 

Don’t  worry  about  the  clutter  or  neatness  ot  tne 
map  as  you  initially  build  it.  There  will  be  plenty 
ot  time  alter  the  interview  to  clean  it  up  . 

Use  either  circles  or  rectangles  to  identity  the 
concepts.  Draw  in  the  lines  or  arcs  and  pointers, 
label  each  arc  with  the  appropriate  linKing  words. 


um  tfte  *xp«rt  a  '.tru  ti  mucn  as  pon.:.t  jc  *nitc 
*nd  dtvt.op  clusters  of  ma p a  tSAt  n  tn*  mv  tn* 

•  xp*rt  is  giving  tn*  i  n  !  trut  i  on  :  ft*  r*.At.onin;pi 
tying  tn*a*  CiUit*n  tog*tn*r  *ut  com  out  *v*ntuA.  .y 
it  tn*  raittioniftipi  don  t  com*  out  or  you  r*  not  iur« 
o!  tn*  r* i * 1 1 onan 1  pa .  ask  tor  tn*  r* *  at i onaa i pa  s*t***n 
Ciuat*ra  during  a  iu in  tn*  Action 

lour  attitude  «m  D*  r*li*ct*d  by  to*  expert 
be  pi* a* Ant  and  poaitiv*.  dhow  g*nuin*  int*r*at  m 
tft*  *xp*rt  and  nia  tftougftta.  Don  t  argu*  witft  nor  interrupt 
tn*  *xp*rt.  Negative  or  adversary  typ*a  ot  actiona 
will  diacourag*  tft*  *xp*rt  and  caua*  ftim/her  to  iooa* 
hia/ft*r  train  of  tftougftt. 

follow  tft*  expert  a  train  of  tftougftt.  uet  mm 
guid*  tft*  flow  tftrougft  ftia  knowledge.  This  doean  t 
mean  let  ftim  aimleaaly  meander  tftrougft  aide  iaau*a  and 
otfter  problem*.  (Jive  ft im/fter  enough  guidance  to  keep 
on  track,  but  alao  freedom  to  relate  it  in  ftia/fter  own 
manner . 

Continuously  ua*  tft*  map  as  a  review  of  tfte  problem. 
Head  aloud  tft*  concept*  and  tfteir  relationships  for 
tft*  expert.  Make  sure  s/ft*  agrees  that  tfte  map  says 
what  s/he  perceives  to  be  correct.  if  it  doesn't,  tften 
change  it. 

If  portions  ot  tft*  map  don't  seem  complete,  query 
the  expert.  it  may  be  tftat  a  portion  of  tft*  information 


is  unciitr  in  to*  ixptrt'i  mind  too. 


Altar  the  interview,  copy  down  tna  concept  maps 
tost  were  drawn  on  the  Doard.  Don't  leave  out  any  of 
the  details.  However,  cleaning  them  up,  correcting 
spelling  and  reducing  clutter  will  make  it  easier  to 
read  later  on.  Taking  a  photograph  oi  the  hoard  may 
he  usetui  and  save  time  hut  is  not  a  necessity. 

4 . do  Conclusion : 

This  chapter  presented  three  lessons  to  learn, 
all  of  which  were  designed  to  prepare  an  individual 
to  begin  concept  mapping  on  their  own.  harts  of  the 
third  lesson  were  specifically  targeted  at  DSS  designers 
so  they  could  start  applying  concept  mapping  in  the 
problem  definition  process.  After  reading  these  lessons 
an  individual  should  have  a  fair  understanding  of  the 
concept  mapping  skill  and  interviewing  technique. 

The  next  chapter  shows  how  and  where  concept  mapp.r. 


fits  in  the  problem  definition  process. 


Chapter  b 


The  Problem  Definition  Process  IPDP) 

b . 00  introduction : 

This  chapter  outlines  a  process  developed  for  the 
adaptive  design  phases  of  OSS  construction  called  Problem 
Definition  Process  IPDFJ  .  The  PDF  is  a  strategy  for 
determining  the  initial  and  iterative  design  requirements 
of  a  DSS . 

The  following  discussion  centers  around  two  main 
points.  The  first  point  discussed  deals  with  the  question 
of  need.  Several  reasons  are  presented  which  support 
the  need  for  a  PDF  strategy  in  the  adaptive  design  method 
of  DSS  development. 

The  second  point  of  discussion  addresses  the  POP 
itself.  Kach  of  the  many  steps  of  the  PDP  is  briefly 
explained.  The  roles  of  the  concept  mapping  technique, 
storyboards,  feature  charts  and  the  iterative  nature 
of  the  PDP  are  emphasized  in  this  discussion. 

b.10  Adaptive  Design: 

A  DSS ' s  basic  purpose  is  to  support  decision  makers 
when  they  are  faced  with  semistructured  and ■ unstructured 
problems.  Decision  makers  find  these  types  of  problems 
to  be  the  greatest  challenges  because  of  limitations 


in  the  mind.  humans  do  their  best  in  structured  situations. 


! 


P) 


The  theories  presented  earlier  show  how  the  mind  stores 
information  (facts  and  concepts)  in  cognitive  structures 
and  levels  of  conceptualisation.  Links  connect  the 
various  levels  and  concepts.  Because  of  the  mind's 
make-up,  structured  problems  are  more  easily  captured 
and  processed.  Once  properly  stored  in  the  mind,  cognitive 
processes  activate  and  the  problem  is  solved. 

Semi-  and  un-structured  problems  are  not  easily 
captured  by  the  cognitive  structures  of  the  mind.  Con¬ 
sequently,  the  cognitive  processes  and  sequences  that 
solve  problems  do  not  work  as  well.  The  inability  of 
the  mind  to  process  the  information  creates  a  greater 
need  for  external  aids  such  as  a  OSS. 

Since  these  problems  are  difficult  for  humans  to 
store  in  cognitive  structures  and  develop  a  sequence 
of  cognitive  processes  for  solving,  they  are  even  more 
difficult  for  humans  to  describe.  The  description  of 
the  problem  as  perceived  by  the  decision  maker  and  his 
understanding  of  the  solution  process  is  needed  so  the 
OSS  supports  his  style  of  decision  making.  Thik  descrip¬ 
tion  lists  ail  the  details  involved  in  setting  the  require¬ 
ments  for  the  systems. 

Sprague  and  Alavi  both  point  out  the  fact  that, 
due  to  the  nature  of  the  problem  types,  traditional 
methods  of  system  development  are  not  possible.  For 
example,  in  the  'life  cycle'  method,  the  total  system 
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requirements  must  be  determined  prior  to  the  start  of 
tne  design  and  deveiopment.  This  can  and  has  been  done 
for  a  variety  of  systems,  but  each  of  these  problems 
were  structured  and  easily  defined.  This  approach  isn't 
feasibie  in  DSS  design.  'DSS  designers  iiteraiiy  'cannot 
get  to  first  base'  because  the  decision  maicer  or  user 
cannot  define  the  functionai  requirements  of  the  system* 
lAiavi ,  iWB4:db).  Sprague  cites  two  reasons  for  this 
inabiiity  for  users  to  describe  the  decision  process . 

First,  a  single,  comprehensive  theory  of  decision  making 
does  not  exist.  Second,  decision  makers  face  rapidly 
changing  conditions  in  the  problem  environment  iSprague, 

1DB0 :1b). 

The  DSS  must  be  developed  in  stages  or  iterations. 

This  means  the  DSS  literally  evolves  into  the  system 
the  user  wants.  The  evolution  of  the  DSS  relies  on 
three  elements:  the  user,  the  builder,  and  the  DSS. 

The  following  is  a  simplistic  recipe  for  building  a 
DSS.  An  initial  problem  definition  and  system  design 
are  described  and  developed.  The  system  design  is 
evaluated.  The  user  provides  feedback  and  alterations 
are  made  depending  on  the  current  decision  environment, 
perception  of  the  decision  maker  and  new  technological 
capabilities.  The  iterative  nature  of  the  development 
allows  the  DSS  to  incorporate  the  most  current  understanding 
from  the  user  and  provide  the  specific  support  s/he 


naada.  Tba  cycia  of  itarationa  la  vary  rapid  and  may 
taka  only  minutaa  to  coupiata  an  aitaration.  This 
davaiopmant  procaaa  la  caiiad  by  many  namaa  but  tba 
moat  common  la  ' adapt iva  daaign* . 

Una  atrangth  of  adaptiva  daaign  la  biddan  in  tba 
procaaa.  Aiavi  pointa  out  tba  fact  that  a a  tba  uaar 
and  bulidar  itarata  through  tba  davaiopmant  of  tba  DSS, 
iaarning  takaa  piaca.  'Tba  uaar  and  daaignar  will  'laarn' 
about  tba  daciaion  taak  and  anvlronmant,  tbaraby  idantifying 
naw  and  unanticipatad  functional  raqulramanta *  (Aiavi , 
1D84:09> . 

ttogua  praaanta  a  iiat  of  tba  'ahouida'  that  adaptiva 
daaign  atrivaa  to  produca  aa  a  DSS  i a  davaiopad.  'Small 
tantatlva  ayatama  abouid  ba  built,  uaad,  and  modifiad 
a a  naadad.  Tba  ayatam  abouid  rafiact  tba  uaar 'a  daciaion 
making  atyia.  Tba  uaar  abouid  ba  an  lntagrai  mambar 
of  tba  davaiopmant  taam.  Tba  ayatam  abouid  ba  built 
quickly,  uaing  tba  iataat  computar  hardwara  and  aoftwara 
tacbnology.  Davaiopmant  abouid  ba  in  tba  handa  of  tba 
uaar  rat bar  than  computar  daaign  prof aaaionaia '  thogua, 
1884:77). 


9.11  Tba  FPl*  and  tba  Adaptiva  Daaign: 


Tba  abova  diacuaalon  pointa  out  fiva  charactar iatica 
of  adaptiva  daaign.  Tba  charactariatica  ara: 


11  Sami-  or  un-atructurad  probiama. 
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2)  iterative  process. 

3)  User  -  builder  learning. 

4 J  Specifying  the  ueer'e  decision  making  style. 

b )  Sapid  alteration  turn  around  time. 

These  characteristics  set  the  requirements  for  defining 
a  problem  space.  A  problem  definition  or  description 
is  necessary  because  it  establishes  the  base  for  the 
initial  DSS  design. 

The  adaptive  design  approach  does  not  demand  a 
full  set  of  system  requirements  prior  to  development 
of  the  USS.  However,  adaptive  design  does  require  an 
initial  understanding  of  the  problem  so  the  iterative 
process  can  start.  Therefore,  a  method  of  capturing 
the  best  possible  understanding  of  the  problem  is  necessary. 
The  TUT  described  below  is  designed  to  give  the  user 
and  builder  a  starting  point  for  their  USS  design. 

The  TUT  provides  a  description  of  the  problem  space, 

Including  a  list  of  key  decision  elements,  a  method 
of  representing  the  USS  design,  and  a  forum  for  system 
evaluation. 

The  TUT  has  three  key  elements.  The  first  element 
uses  concept  mapping  techniques  to  describe  three  phases 
of  the  problem.  The  second  element  presents  a  pictorial 
representation  of  the  USS  so  the  user  and  builder  can 
negotiate  system  requirements.  The  final  element  establishes 
the  criteria  for  judging  the  USS  design  during  that 


iteration.  ‘mere  are  more  detailed  discussions  on  these 
three  elements  later. 

Horn  does  the  yi)y  meet  the  character istics  of  the 
adaptive  design  framework?  The  first  challenge  to  answer 
must  be  Sprague's  reasons  for  the  inability  to  list 
the  full  set  of  system  requirements  before  development. 

The  second  challenge  is  to  show  that  the  yuy  does  meet 
the  requirements  set  forth  by  the  USS  character istics . 

The  ypy  process  includes  the  use  of  concept  mapping 
as  a  capturing  tool  for  the  problem  .definition  and  ident¬ 
ification  of  key  decision  elements.  Concept  mapping 
is  based  on  a  theory  of  structured  mental  storage  and 
linking.  Various  theories  describe  the  cognitive  functions 
of  the  mind  which  include  how  the  mind  makes  decisions. 

(See  chapter  3)  Thus,  the  heart  of  the  yuy  is  based 
on  an  acceptance  of  a  theory  of  cognitive  thinking  and 
decision  making. 

Concept  mapping  also  aids  in  answering  Sprague's 
second  reason.  Concept  maps  capture  the  current  under¬ 
standing  of  the  user.  Concept  mapping  is  a  process 
that  is  quickly  performed  and  easily  interpreted.  Because 


of  the  technique's  flexibility  and  rapid  construction, 
it  works  very  well  in  a  changing  environment.  Also, 
the  yvy  will  iterate  as  often  as  the  other  step  in  the 
adaptive  design.  Thus,  as  the  user  and  builder  'learn 
and  change  their  perceptions,  the  yuy  will  provide  the 
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vehicle  to  support  t&o  modi f lost ions . 

The  i’Di*  str stogy  can  bs  applied  on  tbs  sntirs  rang* 
of  problems,  from  structured  to  unstructured.  it  captures 
the  best  understanding  that  the  user  has  of  tbe  problem, 
its  only  limitation  is  tbe  user's  misconception  of  tbe 
problem  which  is  inherent  in  a  CSS. 

Tbe  power  of  concept  mapping  is  enhanced  by  tbe 
variability  in  tbe  environment.  As  tbe  user  and  builder 
*  learn*,  these  changes  in  understanding  will  be  expressed 
in  each  new  iteration  of  tbe  concept  map.  Tbe  concept 
maps  will  also  reflect  changes  due  to  tbe  decision  making 
environment  and  task.  Concept  maps  made  by  multiple 
users  or  experts  lend  additional  understanding  to  tbe 
description  of  tbe  problem  space  and  decision  process. 

Thus  both  tbe  degree  of  structure  in  tbe  problem,  and 
tbe  limitations  of  tbe  mind  to  describe  are  countered 
within  tbe  rur. 

Another  characteristic  of  concept  maps  fulfills 
tbe  requirement  that  a  CSS  should  be  based  on  tbe  decision 
makers  style.  Concept  mapping  captures  tbe  user's  under¬ 
standing  of  tbe  problem  and  elements  of  tbe  decision 
process  and  translates  that  meaning  to  tbe  builder. 

Since  tbe  description  is  tbe  user's-,  tbe  CSS  designed 
from  that  description  inherits  tbe  user's  decision  making 
style . 

Tbe  FCF  itself  is  an  iterative  process.  Several 


of  th*  stops  repeat  and  iterate  while  producing  just 
ont  iteration  of  th*  design.  As  the  design  requirements 
changs ,  th*  various  stops  in  tho  bDb  act  to  incorporato 
tho  modifications.  bach  of  tho  stops  aro  roiativoly 
simpio,  oasy  to  do,  and  can  bo  roadiiy  manipulated. 

This  foaturo  of  th*  process  fits  in  well  with  tho  iterative 
nature  of  tho  adaptive  design,  and  tho  reduction  in 
turn  around  time  for  each  iteration. 

Thor*  is  one  last  foaturo  of  tho  bUb  that  is  not 
a  requirement  of  tho  adaptive  design,  but  is  oxtromoly 
important  to  any  systom  design.  bach  of  th*  thro*  elements 
of  th*  bbb  provides  a  historical  record  of  the  USS  as 
it  is  developed.  This  record  can  be  used  in  a  variety 
of  ways.  A  DbS  design  manager  could  use  the  information 
as  a  cost  justification  record.  Meador  claims  that 
managers  need  cost  benefit  figures.  'before  approving 
large  scale  DSS  projects  most  managers  need  evidence 
of  some  concrete  benefits  to  offset  development  costs' 
(Meador,  1984:  i’17).  by  having  records  of  smaller  projects, 
realistic  cost  comparisons  can  be  mad*.  Another  use 
for  the  records  would  be  in  designing  other  bbbs  from 
the  same  problem  domain.  Information  about  a  USS  built 
for  scheduling  aircraft  maintenance  may  be  useful  to 
the  designer  of  a  DSS  that  schedules  air  crew  training. 
These  records  would  give  th*  user  and  builder  a  head 
start  on  understanding  th*  problem  space  and'  elements 


of  the  decision  process. 


b . 20  The  Process : 

The  procsss  that  is  being  proposed  is  nothing  more 
than  a  method  of  requirements  determination.  Yadav's 
paper  surveys  the  arena  of  requirements  determination. 

One  of  his  findings  is  that  a  user  'needs  a  methodology 
to  carry  out  the  process  of  information  requirements 
determination  systematically  *  lYadav,  iD83:b).  Yadav 
goes  on  to  show  that  'the  methodology  provides  a  procedure 
to  understand  an  organization  in  order  to  reduce  a  possible 
incongruence  between  actual  and  perceived  requirements, 
it  also  provides  a  tool  to  help  describe  organizational 
functions  in  the  form  of  a  conceptual  model'  l  Yadav, 

14*83:0)  .  figure  b-i  shows  a  diagram  of  Yadav's  method 
of  determining  the  requirements  for  an  information  system. 

Drawing  from  the  methodologies  suggested  by  researchers 
like  Yadav,  Hira,  Davis  and  the  experience  gained  by 
helping  other  students  in  designing  their  DSS  projects, 
the  fDF  was  developed.  The  toy  is  a  tool  for  developing 
the  actual  design  specifications  of  the  prototype  DBS 
and  then  aiding  its  expansion  into  the  full  system. 

The  yoy  also  doubled  as  a  monitoring  device  to  keep 
track  of  the  researcher's  progress  and  as  a  guide  for 


the  next  set  of  actions. 
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K i jure  b-i.  Uiar ‘s  formal  and  correct  raquiremant 
and  the  corresponding  information  system  design. 

I Yadav ,  iuad:OJ 

As  mentioned  above,  there  are  three  Jcey  elements 
to  the  FUJP.  hach  step  within  the  elements  is  explained 
below.  This  is  a  suggested  strategy  to  use  in  developing 
the  design  specifications  of  the  DSS  from  inception 
to  full  operation.  This  method  fits  within  the  iterative 
nature  of  adaptive  design  and  is  intended  to  be  iterative 


itself  . 


Davis  surveyed  the  currant  field  of  initial  requirements 
determination  and  identified  four  strategies.  TUese 
strategies  are:  i>  asking,  2)  deriving  from  existing 
information  system,  2)  synthesis  from  characteristics 
of  the  utilizing  system,  and  4J  discovering  from  experimenta¬ 
tion  with  an  evolving  information  system  (Davis,  idu2:12J. 

The  yuy  strategy,  as  described  below,  actually 
incorporates  the  majority  of  these  strategies.  first, 
the  FDf  uses  concept  mapping  in  the  direct  asking  type 
of  strategy.  As  Davis  points  out,  asking  yields  satisfactory 
results  especially  in  the  higher  structured  problems. 

Deriving  from  existing  systems  can  be  easily  done 
with  the  built-in  record  keeping  function  of  the  concept 
maps,  feature  charts ,  storyboards,  and  evaluation  criteria. 

As  mentioned  above,  this  information  will  aid  future 
DSS  designers  working  on  similar  problems,  as  well  as 
being  a  teaching  aid  for  new  designers. 

Adaptive  design  itself  exploits  the  third  and  fourth 
strategies  of  requirement  determination.  by  rapidly 
building  and  modifying  the  system  and  using  ready  built 
hardware  and  software,  the  user  and  builder  create  the 
system  requirements  with  each  iteration.  Thus,  they 
use  the  knowledge  .built  into  the  current  technology 
and  the  'learning  through  experimentation'  to  delineate 
the  final  DSS  requirements. 

The  following  discussion  explains  the  steps  of 


the  PDP.  Mgurt  9-2  depicts  the  steps  of  the  PDP  in 
a  time  linear  relationship .  (ienerally,  the  first  iteration 
will  follow  this  sequence.  After  the  first  iteration, 
the  steps  occur  in  the  sequence  that  the  user  and  builder 
decide  is  most  appropriate.  As  the  design  team  evaluates 
various  parts  of  the  DSS,  they  will  find  needs  for  changing 
the  current  design.  There  is  nothing  wrong  with  returning 
to  the  problem  definition  step  and  progressing  through 
the  entire  process.  However,  most  designers  will  return 
to  the  step  in  the  process  that  is  affected  by  the  change 
and  make  the  alterations.  This  strategy  speeds  up  the 
iteration  and  aids  the  collection  of  design  requirements. 


Problem  Definition  Process  (PDP) 
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Pigure  S-2.  The  .Problem  Definition  Process  IPDP) 


b  .  2  1  The  Flag: 


The  flag  is  an  indicator.  It  alerts  the  decision 
maker  to  the  existence  of  a  problem.  Soma  control  nactanisn, 
or  gut  faaling  will  raisa  a  signal  flag  informing  tha 
managar  that  a  problam  or  opportunity  axista.  Tha  managar 
may  racogniza  that  tha  problam  is  auitabia  for  a  Db'S. 

Only  than  can  ha  taka  action  to  bagin  tha  dasign  and 


davalopmant  of  a  dacision  support  aystam. 


b • W  Problem  Description  -  Tha  Hole  of  Concept  Mappini 


HA 

ij 


Tha  first  stage  in  designing  a  f)SS>  is  to  identify 
tha  key  dacision la) .  Kean  talks  about  laying  out  tha 
key  dacision  is)  within  tha  framework  of  tha  problem 


space.  'This  helps  identify  which  decisions  are  of 
most  importance  for  affective  performance  and,  of  course, 
which  may  benefit  from  decision  support.  if  one  then 
assesses  the  quality  of  informational  and  analytical 
aids  for  each  key  decision,  one  can  bagin  to  get  a  sense 
of  potential  priorities  for  more  detailed  analysis' 


IKeen ,  1970: 17b) 
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To  identify  the  key  dacision,  Kean  suggests  a  cycle 
of  steps  for  the  predesign  phase  ISee  Kigure  b-b) . 

In  this  cycle,  Kean's  emphasis  is  on  the  first  step. 

The  step  calls  for  a  descriptive  study  of  the  problem. 
'The  major  aim  of  this  predesign  cycle  is  to  make  sure 
that  the  right  problem  is  worked  on.  There  are  ,  of 


course,  many  interaction*  witbin  tbe  cycle;  objectives 


influence  wbat  the  key  decision  will  be  and  tbe  areas 
to  be  supported  partly  define  available  resources  and 
vice  versa*  (Keen,  1978:173).  His  recommendation  to 
designer's  of  a  DSS  is  to  complete  two  full  iterations 
of  tbe  predesign  cycle  before  beginning  tbe  detailed, 
more  formal  definition  of  system  requirements  and  speciii 
ations.  However,  with  tools  like  concept  mapping  and 
tne  overall  strategies  built  into  tbe  HDF,  two  cycles 
are  not  necessary  unless  it's  tbe  choice  of  tbe  team. 


Figure  0-3.  Tbe  ^redesign  Cycle  (Keen,  1978:174) 


Keen's  cycle  demonstrates  the  importanca  of  the 
problem  description  phase.  Keen  believes  that  by  attaining 
the  best  description  possible,  the  user  and  builder 
can  define  the  key  decision  and  elements  that  make  up 
that  decision.  The  description  phase  is  exactly  where 
the  concept  mapping  supports  the  development  of  the 
DSS.  in  the  fUF  the  descriptive  phase  has  three  steps. 
These  three  steps  are  the  problem  definition,  task  analysis 
and  the  data  analysis.  Concept  mapping  provides  a  vehicle 
or  tool  for  the  design  team  to  fully  describe  the  problem. 

S.221  Problem  Definition: 

The  first  use  for  concept  mapping  is  to  define 
the  problem  space.  The  user  constructs  a  concept  map 
based  on  his  tinderstanding  of  the  problem.  tie  attempts 
to  define  what  the  problem  is  by  showing  the  key  concepts 
involved  in  the  problem  and  how  they  link  together. 

This  map  is  then  used  by  both  the  user  and  builder  to 
negotiate  the  meaning  in  the  map.  This  negotiation 
actually  is  an  iteration  of  the  definition  because 
the  user  must  fully  explain  or  restate  confusing  portions 
of  the  map  so  the  builder  'learns'  and  understands. 

The  map  becomes  a  graphical  representation  of  the 
problem  space.  Since  the  concept  map  is  the  road  map 
that  the  design  team  is  following,  put  it  on  large  sheets 
of  paper  and  hang  them  on  the  walls  for  all  to  see. 


by  always  keeping  the  map  up  in  front  of  the  design 
team,  changes  In  daclsion  environment,  decision  task, 
or  psrcsptions  can  be  quickly  locatsd  and  rscordsd. 

Maps  from  several  ussrs  or  multiple  maps  from  tna  samt 
ussr,  crsatad  ovsr  tims,  can  bs  compared  and  svaluatsd 
for  tbs  combinsd  understanding  and  identification  of 
key  concepts  and  misconceptions .  , 

Tbe  map  also  depicts  tbe  limits  of  tbe  problem 
space.  The  links  and  concepts  show  tbe  boundary  of 
tbe  problem  and  may  even  express  it  explicitly.  Thus 
tbe  map  allows  tbe  design  team  to  understand  tbe  problem 
and  identify  tbe  bounds  on  tbe  problem  as  perceived 
by  tbe  user. 

a.  222  Task  Analysis: 

Tbe  second  phase  of  tbe  problem  description  uses 
concept  mapping  to  identify  tbe  key  decision  elements. 
Traditional  computer  design  would  call  this  phase  tbe 
task  analysis.  A  task  analysis  is  tbe  listing  and 
sequential  ordering  of  tbe  individual  tasks  necessary 
to  solve  a  problem.  There  are  a  variety  of  methods 
designed  to  accomplish  this  task,  such  as  flow  charts 
and  pert  charts.  Task  analysis,  used  in  this  sense, 
operates  on  very  highly  structured  problems.  Tbe  task 
to  be  captured  by  concept  mapping  is  tbe  individual 


processes  that  are  used  in  tbe  solution  to  a  semi-  or 


un-structured  problem.  in  this  i«ni«,  t he  ordering 
of  the  task  is  not  necessarily  linear  or  sequentially 
wail  dofinod. 

There  are  other  methods  that  art  being  davaiopad 
to  identify  kay  element*  in  tbe  decision  process.  On* 
of  those  methods  is  C-MAH.  C-kAP  as  proposed  by  Hira 
and  Mori  attempts  to  determine  the  need  statements  of 
a  problem.  in  their  problem  analysis  phase  is  a  task 
called  'structuring  the  problem*.  'in  this  process, 
complex  factors  are  arranged  in  order  and  critical  points 
for  problem  solution  are  found*  (Hira,  IWBk: lib).  The 
process  seems  to  be  a  mix  of  traditional  task  analysis 
and  cognitive  task  identification'.  The  big  drawback 
of  this  process  is  the  reliance  on  a  structured  problem 
or  process . 

During  the  task  analysis  phase,  the  user  constructs 
another  set  of  concept  maps  concentrating  on  his/her 
perception  of  the  decision  process.  The  purpose  of 
these  maps  is  to  identify  the  cognitive  task  necessary 
for  solving  the  problem.  The  user  describes  the  process 
s/he  would  use  to  solve  the  problem.  In  reality,  the 
user  activates  his  K-iines,  or  the  ones  he  thinks  are 
most  appropriate,  and  records  the  results.  The  map 
captures  the  events  or  cognitive  tasks  in  a  graph. 

The  order  and  specific  sequence  is  not  represented  except 
in  very  structured  problems  or  in  the  structured  parts 
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of  unstructured  problems.  But,  the  elements  of  the 
decision  making  process  are  captured.  This  map  can 
then  be  presented  to  tne  rest  of  the  design  team  for 
another  negotiation  of  meaning. 

Once  the  decision  process  map  is  constructed,  an 
evaluation  of  the  key  decision  elements  is  undertaken. 
This  is  not  a  formal  evaluation,  but  an  informal  search 
for  the  kernels  from  which  a  DBS  could  be  built.  The 
design  team  lists  ail  of  the  possible  kernels  and  their 
role  in  the  overall  decision  process  that  were  found 
in  the  process  map.  Chapters  0  and  7  will  demonstrate 
the  problem  description  process  and  show  the  many  kernels 
identified  from  a  variety  of  problems. 

H.UUii  Uata  Analysis: 

The  third  and  final  phase  of  the  problem  description 
comes  directly  from  traditional  computer  system  design. 
Once  the  process  maps  are  constructed,  they  can  be  used 
to  establish  the  input  and  output  specification  of  the 
system. 

Concept  maps  from  the  task  analysis  provide  the 
graphical  representation  of  the  processing  taking  place 
in  the  system.  By  adding  the  input  and  output  parameters 
to  the  events  represented  on  the  process  map,  the  design 
team  has  a  pictorial  representation  of  the  data  require¬ 


ments  . 


The  data  analysis  is  a  rather  simple  process  because 
it  works  with  vary  highly  structurad  parts  of  tha  probiam. 

Tha  design  taam  takas  tha  task  analysis  maps  and  idantifias 
tha  type,  format,  and  form  of  information  raquirad  and 
lists  it  on  tha  concapt  map.  This  idantif ication  is 
accomplishad  for  aach  avant  or  procass  taking  piaca 
in  a  dacision  aiamant.  Tha  sam a  procadura  is  foilowad 
for  tha  output  as  wall.  Aftar  all  tha  input  and  output 
idantif ications  ara  mad a ,  a  complata  sat  of  data  requirements 
ara  compilad  and  form  tha  baglnnings  of  tha  systam  raquira¬ 
mants.  In  actuality  tha  usar  did  not  construct  any 
naw  maps,  but  modifiad  tha  task  analysis  map  to  rafiact 
tha  data  raquiramants . 

Tha  thraa  alamants  of  tha  probiam  dascription  work 
togathar  to  prasant  a  complata  pictura  of  tha  probiam 
spaca.  It  may  hava  takan  savaral  itarations  among  tha 
thraa  sats  of  concapt  maps,  but  tha  bast  undarstanding 
of  tha  probiam  spaca  is  undarstood  by  tha  design  taam 
and  is  raprasantad  in  an  easy  to  review  and  modify  format. 

Once  this  information  has  bean  collected ,  the  initial 
design  of  tha  DSS  is  ready  to  begin.  Kor  aach  of  tha 
identified  karnais  tha  taam  needs  to  create  a  set  of 
feature  charts  and  storyboards  depicting  a  pictorial 
representation  of  tha  l)SS  and  its  functions. 


5 . 23  feature  Charts  and  Storyboards: 

in  the  phase  of  the  problem  definition  process , 
the  design  team  takes  what  they  Qav«  di>cov«r«d  from 
describing  tha  problem  and  starts  to  form  it  into  a 
daacription  of  tba  DSS.  The  two  procaaaaa ,  feature 
c&arta  and  atoryboarda,  are  off -shoots  of  tbe  KOMC  approach 
of  Sprague  and  Cariaon.  Tbe  following  diacuaaion  takes 
a  brief  look  at  tbe  these  three  topics  and  their  role 
in  the  fDF. 

Spra  ue  and  Carlson  made  five  observations  about 
decision  makers.  'first,  decision  makers  have  trouble 
describing  a  decision  making  process ,  but  they  do  seem 
to  rely  on  conceptualizations ,  such  as  pictures  or  charts, 
when  making  or  explaining  a  decision.  Second,  Simon's 
intelligence-design-choice  scheme  can  be  useful  in  categor¬ 
izing  decision  maker's  activities,  even  though  the  decision 
making  process  may  be  difficult  to  explain.  Third, 
decision  makers  need  memory  aids.  fourth,  decision 
makers  have  different  styles,  skills,  and  knowledge, 
finally,  decision  maker's  expect  to  exercise  direct  personal 
control  over  their  support'  (Sprague,  ( y«2:ya-yy;. 

These  observations  led  them  to  propose  the  KOMC  approach 
to  DSS  design. 

The  KOMC  approach  is  a  process  independent  approach 


to  defining  the  requirements  and  specifications  of  a 
DSS .  Their  original  recommendation  was  to  use  flow 


charts,  input-output  models  and  other  pictorial  devices 
to  represent  the  different  parts  of  the  DSS.  The  four 
components  of  the  HOMC  approach  are  K-Kepresentations , 
U-Operations ,  M- Memory  aids,  and  U-Controi  mechanisms. 

The  USS  is  divided  up  by  the  four  components  and  described 
with  respect  to  each  of  them.  This  makes  the  KOMC  approach 
'a  framework  for  identifying  the  required  character istics 
and  capabilities  of  a  specific  USS*  (Sprague,  iyS2:libJ. 

AS  a  framework  for  design,  KUMC  works  very  well. 

KOMC ' s  guidance  provides  the  design  team  with  the  basic 
tools  to  describe  and  depict  the  DSS.  However,  feature 
charts  and  storyboards,  which  where  derived  within  the 
HOMO  framwork,  provide  much  clearer  and  more  flexible 
description  tools.  These  tools  enable  the  user  to  see* 
the  design  of  the  OSS  as  it  is  developed. 

feature  charts  provide  the  process  aspect  of  the 
DSS.  'The  feature  chart  shows  the  features  of  the  system 
with  which  the  user  Interacts.  These  features  are  the 
representations ,  operations,  and  control  mechanisms, 
as  well  as  the  supporting  memory  aids*  (Seagie,  iyub:i3>. 

figure  S-4  shows  a  feature  chart  from  a  DSS  design 
as  a  class  project.  Sach  symbol  represents  a  specific 
component  of  the  DSS.  Solid  lines  depict  control  transfer; 
parallelograms  depict  menus;  curved  rectangles  are 
files;  and  plain  rectangles  show  operations. 


Klgura  3-4.  Kaatura  Chart 


Tha  faatura  chart  shows  both  tha  usar  and  tha  buildar 
tha  parcaptiona  of  tha  OSS  and  tha  uaar'a  naada.  Thia 
chart  ahowa  tha  data  flow,  pointa  of  control,  and  propoaad 
patha  of  aaquantiaily  ordaring  tha  procaaaaa.  Thua , 
tha  faatura  chart  la  a  pictorial  for  tha  daaign  taam 
to  nagotlata  tha  Initial  OSS  daaign. 

Silnca  tha  faatura  chart  laya  out  tha  organization 
of  tha  ayatasi,  tha  atoryboard  data!  la  aach  conponsnt . 
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Andriola  offers  a  tool  to  tha  dasign  t«aa>  that  axploits 
both  tha  KOMU  approach  and  tha  human's  dasira  to  daacriba 
things  with  pictures.  Ona  way  to  axpiain  a  storyboard 
is  to  iook  at  a  comic  strip.  kach  frama  in  a  comic 
strip  shows  a  diffarant  pictura  that  supports  tha  story 
iina.  Tha  DSS  storyboard  doas  tha  sama  thing.  Kach 
frama  is  tha  proposad  monitor  scraan  that  tha  usar  would 
saa  whan  tha  DSS  is  up  and  running.  Comparing  it  to 
tha  faatura  chart,  aach  component  on  tha  faatura  chart 
would  hava  its  own  frama  in  tha  storyboard.  Thus,  tha 
usar  and  tha  bulldar  would  saa  and  agraa  on  tha  usar 
intarfaca . 

This  storyboard  carrias  a  lot  of  information. 

Tha  usar  daaigns  tha  frasia  by  putting  in  tha  nacassary 
information,  suggastad  output  format,  and  dasirad  controls 
for  tha  oparation.  It  also  lats  tha  usar  hava  a  forum 
in  which  to  dascrlba  tha  undariying  oparation  that  would 
taka  placa.  Tha  bulldar  glaans  tha  raquiramants  from 
tha  frama  daallng  with  tha  data  fiia  and  procassmg 
intaractions ,  and  input/output  formatting.  Tha  bulldar 
can  also  usa  tha  frama  as  a  forum  to  dascrlba  aitarnativa 
formats  and  controls.  Storyboards,  just  lika  concapt 
maps  and  faatura  charts,  ara  communication  davicas  that 
halp  tha  dasign  taam  to  datarmlna  raquiramants  for  sami- 
and  un-structurad  problams. 


b .  Evaluation : 

The  final  phase  of  the  problem  definition  process 
is  the  weakest.  Very  little  has  been  written  on  the 
subject  of  DSS  evaluation,  but  this  is  the  key  issue 
in  designing  and  successfully  developing  an  effective 
decision  aid.  Muck  more  research  and  development  on 
the  criteria  for  evaluating  the  storyboards,  feature 
charts,  and  concept  maps  needs  to  be  done. 

As  of  this  writing,  the  best  recommendation  for 
criteria  lies  in  the  common  sense  of  the  design  team. 
However,  four  areas  may  help  to  focus  the  evaluation 


of  the  DSS  design.  These  four  evaluation 


derived  from  Sprague  and  Carlson's  four  measures  of 

DSS  evaluation.  These  four  measures  are:  U  Productivity, 

U)  Process,  3)  Perception,  and  4)  Product  (Sprague, 

IVttU: 100) . 

The  design  team  should  review  the  products  of  the 
PUP  with  regard  to  several  points  of  view.  hirst ,  the 
user  interface  should  have  little  if  any  distraction, 
is  the  DSS,  as  designed,  easy  for  the  user  to  learn 
and  use?  How  often  does  he  need  to  use  the  help  function? 
Second,  has  the  decision  environment,  task,  or  user 
perceptions  changed?  If  something  has  changed,  what 
are  the  effects  on  the  design?  Third,  look  at  the  service 
that  the  OSS  is  providing.  Do es  the  DSS  support  the 
decision  maker  in  the  actual  problem  or  is  it  not  accurately 
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focused?  Does  the  1)SS  support  other  problems  that  were 
not  initially  stated  in  the  design?  if  so,  does  tAis 
extra  support  distract  tbe  user  from  the  primary  purpose 
of  tbe  DSS?  Finally,  tbe  design  team  needs  to  look 
at  tbe  productivity  of  tbe  DSS.  bow  well  does  tbe  DSS 
perform?  is  it  worth  tbe  cost  of  development  and  continued 
use? 

While  little  bas  been  written  on  tbe  subject,  one 
paper  is  noteworthy.  Adel man,  book  and  Lehner  evaluated 
five  USAF  DSS  prototypes  that  aid  tactical  decision 
making.  To  complete  this  assignment,  they  developed 
a  questionnaire  that  looked  at  three  separate  interfaces. 
Tbe  three  interfaces  are  tbe  DSS/user,  tbe  User-USS/ 
Organization,  and  tbe  Organization/bnvironment .  lAdeiman, 
itfbSJ 

Although  tbe  results  of  tbe  evaluation  are  not 
important  to  this  paper,  tbe  fact  that  an  evaluation 
could  be  approached  in  this  matter  is.  These  are  just 
two  examples  of  tbe  many  ways  an  evaluation  could  be 
structured- and  implemented. 

S . 2S  Kernels : 

This  entire  process  of  determining  tbe  specification 
can  be  done  in  two  ways.  Tbe  choice  is  based  on  tbe 
design  team  and  bow  they  view  tbe  problem  space  and 
its  kernels.  First,  tbe  FOF  can  operate  on  one  or  more 


kernels  at  a  time.  For  very  large  problem  spaces  with 
many  kernels,  this  is  the  recommended  approach.  This 
approach  breaks  up  the  design  into  smaller  chunks  or 
pieces.  The  advantage  in  chunking  the  OSS  design  is 
to  allow  the  design  team  to  develop  kernels  and  groups 
of  kernels  at  different  rates.  The  rate  is  based  on 
the  user's  understanding  of  that  portion  of  the  problem 
and  the  capability  of  technology  to  support  the  development. 
Thus  the  design  team  gains  the  ability  to  focus  scarce 
resources  on  feasible  and  more  highly  promising  parts 
of  the  OSS. 

As  the  specif ications  of  these  pieces  of  the  overall 
OSS  are  collected*  comparisons  and  evaluations  among 
the  kernels  and  their  roles  in  the  OSS  can  take  place. 

These  evaluations  give  upper  management  the  information 
they  need  to  manage  the  development  of  the  OSS. 

The  second  strategy  allows  the  FOF  to  establish 
the  design  requirements  on  all  the  kernels  identified. 

This  should  be  used  when  developing  a  simple  OSS.  This 
approach  makes  all  kernels  of  equal  value  and  progresses 
them  at  an  equal  pace  in  development. 

b . 30  Conclusion : 

This  chapter  presented  two  key  issues.  The  first 
issue  was  the  need  for  an  adaptive  design  for  develop¬ 

ment.  A  OSS  was  shown  to  be  an  aid  for  problems  that 


lacked  structure  and  could  not  be  defined  by  a  complete 
set  of  requirements  prior  to  development.  Therefore, 
this  type  of  system  needed  to  be  developed  in  an  evolutionary 
manner.  The  second  issue  proposed  a  method  ll'DP)  and 
the  tools  (concept  mapping,  storyboards,  and  feature 
charts)  to  determine  the  requirements  for  a  DSS.  The 
method  divided  into  three  major  elements,  each  with 
separate  steps  and  tools.  The  yuy  was  proposed  as  an 
iterative  process  that  evaluates  the  design  and  records 
the  DSS  modifications. 

Chapter  0  records  the  results  of  experimenting 
with  concept  mapping  as  a  tool  for  acquiring  the  problem 
definition  and  identifying  the  kernel.  Later  in  chapter 
0  are  examples  of  concept  mapping's  integration  into 
the  design  phase  of  a  DSS  through  the  adaptive  design 


approach . 


Chapter  0 


Examples  of  Concept  Mapping  Applied  to  .Problem  Description 


tt.00  Introduction : 

This  chapter  is  a  compilation  of  examples.  Several 
exercises  in  DSS  design  are  listed  as  examples  of  actual 
applications  of  the  concept  mapping  technique.  These 
exercises  explore  a  variety  of  problem  domains. 

A  short  discussion  introduces  each  example  and 
then  shows  the  results  of  the  concept  mapping  exercise. 

The  concept  maps  that  either  define  the  problem  space 
or  describe  the  decision  process  are  shown  in  accompanying 
figures.  in  some  of  the  examples,  a  table  lists  the 
kernels  identified  in  the  exercise.  Two  of  the  exercises 
also  include  the  entire  DSS  design  showing  examples 
of  concept  mapping,  feature  charts  and  storyboards. 


b.01  Source  of  Examples; 

These  problems  came  from  three  sources.  The  first 
problem  is  a  test  case  problem.  It  demonstrates  to 
analysts  what  a  concept  map  looks  like  and  how  concept 
mapping  can  identify  the  kernels  in  a  DSS  design.  The 
rest  of  the  examples  are  actual  USE  projects  derived 
from  either  class  assignments  or  thesis  proposals. 


MEW 


0 . 02  Prude  Map a ! ? 


The  maps  listed  in  the  following  exercise  are, 
in  many  cases ,  the  map  exactly  as  it  was  constructed 
and  finalized  from  the  interview.  Consequently ,  the 
maps  appear  in  a  crude  format.  There  are  two  reasons 
the  maps  are  left  in  this  crude  state.  The  first  reason 
is  to  show  the  new  concept  mapper  that  although  neatness 
is  helpful,  it  is  not  absolutely  necessary  for  the  transfer 
of  understanding.  The  crudeness  of  the  tool  does  not 
detract  from  the  communication  ability. 

The  second  reason  for  the  crude  state  of  these 
maps  is  to  show  that  maps  need  to  be  flexible  and  created 
quickly  so  as  not  to  stifle  the  creativity  of  the  source. 
During  the  interview  the  concept  mapper  needs  to  concentrate 
on  the  source  and  capturing  his/her  concepts  and  links. 

If  the  concept  mapper  worries  about  neatness ,  the  constant 
'fixing'  of  the  map  will  distract  the  source  and  may 
even  lose  the  meaning. 

There  is  plenty  of  time  after  the  interview  to 
clean  up  maps.  By  using  the  audio  tape  recordings, 
details  can  be  added  and  hierarchial  relationships  checked. 
Formal  presentations  and  reports  may  require  the  analyst 
to  formalize  the  maps  similar  to  the  style  shown  m 
the  next  chapter.  For  the  adaptive  design  process, 
the  original  maps  in  their  original  format,  prominently 
displayed,  is  enough  to  keep  the  problem  focused  for 


the  entire  design  team. 


d.03  Why  the  reader  may  not  agree  with  the  kernels: 

The  kernels  identified  are  based  on  the  perception 
of  the  user  who  created  the  map  and  the  reader  who  is 
interpreting  the  map.  With  two  different  people  reading 
the  same  map,  different  kernels  may  be  identified 
because  of  their  perceptions.  This  means  the  team  of 
OSS  designers,  users  and  builders,  must  agree  by  negotiating 
the  meaning  represented  in  the  concept  map.  Then  the 
team  can  list  and  evaluate  all  possible  kernels  to  determine 
the  key  kernel  is).  This  selection  of  key  kernels  sets 
the  OSS's  style,  design  direction  and  the  team's  perception 
of  the  problem  solution  process. 

0.10  Example  1  -  Buying  a  Car: 

When  concept  mapping  was  first  considered  as  a 
technique  for  problem  definition  and  kernel  identification, 
it  needed  a  test  case,  or  test  problem.  The  purpose 
for  this  problem  was  to  demonstrate  to  a  OSS  designer 
the  ability  of  the  concept  mapping  technique.  The  problem 
had  to  be  a  reasonably  good  forum  for  a  OSS  and  yet 
common  enough  for  any  designer  to  relate  to  easily. 

The  problem  chosen  was  'buying  a  car'.  This  problem 
space  had  one  big  advantage.  'Buying  a  car'  was  a  decision 
most  people  have  experienced.  This  meant  decision  makers 


already  had  many  of  tha  decision  processes  established 
in  their  minds  and  could  readily  recall  them.  The  concept 
mapping  technique  was  then  introduced  to  the  decision 
maker  without  worrying  about  having  to  teach  all  the 
details  of  the  problem.  Thus ,  it  made  a  good  example. 

The  observers  were  relatively  familiar  with  the  problem 
domain  and  were  able  to  concentrate  on  the  concept  mapping 
The  'buying  a  car’  problem  has  been  the  main  example 
in  every  introductory  presentation  of  concept  mapping 
to  date. 

With  the  problem  domain  chosen,  a  concept  map  was 
created  to  show  the  tasks  in  the  process  this  author 
would  use.  The  up  is  shown  in  figure  0-1.  Based  on 
this  map  several  kernels  were  identified.  Some  of  them 
are  listed  in  table  0-1. 

Possible  Kernels  for  a  DBS  on  'Buying  A  Car’ 

Working  the  BUDQET  portion  of  the  decision  process 

■  Cash  flow  sheets  for  monthly  bills 

*  T-accounts  for  savings 

*  Loan/Interest  payment  models 

*  Leasing  payment  models 

Checking  the  Market 

■  Data  base  on  maker’s  offers  and  inventory 

Buyer  Wants 

*  Data  base  to  list  and  rank  user  desires 
-  Other  Options 

*  Data  base  on  each  of  the  available  alternatives 

■  Cost  modeling  on  each  of  the  alternatives 

Table  0-1.  Possible  Kernels 


O-i, 


Concept  Map; 


a  far' 
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Capt  Bill  Adams'  initial  thesis  proposal  suggested 
a  USB  to  assist  t ns  decision  maiesrs  of  the  u.S.Army 
in  distributing  tanks  to  various  units.  Consequently , 
be  worked  on  developing  tbe  definition  of  tbe  problem 
using  concept  mapping.  After  several  interviews  and 
a  variety  of  concept  maps,  be  determined  that  DBS  was 
not  tbe  best  way  to  approach  this  problem  because  tbe 
structure  of  tbe  decision. 

Tbe  exercise  with  Capt  Adams  was  not  counted  as 
a  failure.  Tbe  concept  maps  created  did  show  tbe  problem 
space.  Also,  tbe  concentration  required  on  bis  part 
helped  him  to  understand  tbe  problem  more  clearly. 
Kinally,  valuable  time  was  saved  by  not  pursuing  an 
inappropriate  solution  method. 


0 . 40  Example  4  -  Pilot  Training  Scheduling 


Capt  haul  Trapp  and  Capt  Jeff  Urechanik  chose  to 


build  a  DBS  that  assisted  a  scheduler.  Tbe  resources 


that  needed  to  be  scheduled  were  pilot  trainees  and 
instructors.  Both  officers  bad  held  tbe  position  in 
earlier  assignments.  Therefore,  both  were  taken  to 
be  tbe  experts  as  well  as  tbe  builders. 

This  example  held  two  noteworthy  events.  hirst, 
this  example  was  tbe  first  to  apply  concept  mapping 
to  tbe  actual  design  of  a  DBB  and  also  continue  tbe 


process  through  to  a  fully  operating  prototype.  Second, 
it  was  tne  only  example  of  a  OSS  design  that  used  more 
than  one  expert.  Multiple  experts  would  not  be  encountered 
again  until  concept  mapping  was  applied  to  the  Sapid 
Application  of  Air  Fower  problem  space. 

Several  specific  steps  were  taken  to  concept  map 
the  problem  and  decision  process.  First,  each  expert 
independently  prepared  a  list  of  what  they  thought  were 
the  key  concepts  in  the  scheduling  problem.  Most  of 
the  concepts  were  events,  tasks  that  the  scheduler  needed 
to  do.  From  these  lists  the  builders  grouped  and  time 
ordered  the  concepts.  Table  8-2a  through  «-2c  and  figure 
0-3a  show  the  concepts  chosen  and  reordered  by  the  builders 

Only  after  each  expert  had  thought  through  the 
exercise  of  key  decision  processes  and  ordering  did 
they  come  together  and  build  their  first  joint  concept 
map.  This  first  map  accomplished  two  key  goals.  The 
goals  accomplished  were:  1)  defined  the  problem  space 
to  a  mutual  agreement  and  understanding  of  both  experts 
and  2)  taught  this  author  about  the  intricacies  of  sched¬ 
uling.  During  the  exercise,  many  discussions  occurred 
between  the  two  builders  concerning  the  other's  choice, 

t 

placement  and  grouping  of  concepts.  The  resulting  problem 
definition  map  is  shown  in  figure  0-4b/c. 

Several  interviews  were  held.  They  resulted  m 
a  series  of  maps  that  attempted  to  capture  the  process 
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a  scheduler  went  through  in  his  daily  selection  and 

Key  items  to  Perform  Daily 

»  Check  yesterday's  schedule  to  make  sure  all  flights 
went  as  scheduled. 

Note  deviations  -  find  reason  (weather,  sick, etc). 
Update  boards. 

*  (lather  ail  inputs  for  tomorrow's  schedule 

Who's  available? 

-  DN1F. 

-  TDK . 

Leave . 

Academics. 

Appointments. 

*  Determine  ail  f iying/training/ground  events  to  be 
filled. 

-  Flights . 

Simulators. 

Academic  Classes. 

»  Fill  lines. 

-  Make  sure  formations  match  missions. 

Students  first. 

-  Shuffle  instructors  so  that  they're  assigned  correctly 

*  Fill  academics  first. 

*  Fill  duties  second  (important  duties) . 

-  big  3. 

*  Kamp  officer. 

Appointments. 

-  S  O  F. 

*  Fill  piddly  stuff  last. 

-  K  C  0. 

Appointments. 

Meetings. 

*  Deconflict  throughout  schedule. 


Table  d-2 a.  (irechanik's  list  of  key  concepts. 


Key  items  to  Perform  Daily 

*  Kill  in  grease  board  with  times,  simulators,  academics, 
meetings,  which  ride  student's  on. 

*  Deconflict  academic  classwise 

»  Kill  in  instructor  absences ,  DN1K,  meetings,  on  the 
deconf liction  board. 

*  Kill  in  set  rides  such  as  check  rides,  DO  flying 
with  squadron. 

*  Look  at  graduation  dates  or  class  or  individual  furthest 
behind  (red  dots  only  fly  once)  . 

*  Kill  in  student  names  and  which  ride  they  are  on. 

»  Look  for  type  rides  lair-to-air)  or  lair-to-ground) . 

*  Kut  in  student  names  with  a  match  from  the  ride  they 
are  on  compared  to  the  configuration  of  the  planes  at 

a  specific  take-off  time. 

ft  Kill  in  exclusive  periods  for  each  class  first  using 
previous  step  . 

ft  Match  IK  to  student  names  according  to  squadron  rules. 
Kor  example,  the  434th  has  a  primary  and  secondary  IK 
assigned  to  the  student.  If  neither  the  primary  or 
secondary  IK  is  available  then  match  the  student  with 
a  IK  from  his  flight.  if  none  of  his  flight  is  available, 
then  any  IK  will  do. 

ft  iterate  ail  steps. 

Table  b-2b.  Trapp's  list  of  key  concepts. 


Ordered  Key  Concepts 

1)  Ensure  data  from  today's  Schedule  is  updated  once 
flying  is  complete  for  today's  schedule. 

(night  before  or  first  thing  in  the  morning) 

2)  Write  up  the  shell  on  tomorrows  portable  grease 
board . 

3)  Write  in  hardlines. 

4)  write  in  DNlhs,  leaves,  KCU ,  SO K  (duty  hog). 

b)  Talk  to  Big  3  (Sq  OC ,  Ops  Off,  Ast  Ops  Off). 

b)  Write  in  academic  schedule  classes  and  instructors 
(weekly)  . 

7)  Matching  process: 

a)  students  < - >  instructors 

1)  Look  for  assigned  instructor 

2)  Look  for  ll*  in  flight 

3)  Look  for  anyone 

B)  Schedule  Big  3. 

U)  Schedule  simulators. 

10)  Schedule  duty  hog. 

11)  fill  in  deconf iiction  board. 

12)  Write  daily  grease  board  up  on  large  board  - 

<io  hi  KM  •  *  h  1  KM  TIME' 


Table  8-20.  Trapp's  first  ordering  of  key  concepts. 
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JKigure  0-3a.  UrecftaniJc '  a  ordering  of  key  concepts 


matching  of  r«aourc«t.  The  final  map,  snowing  the  combined 
understanding  of  the  process,  is  shown  in  figure  d-3d. 
from  this  map,  Capt  Trapp  and  Uapt  (irechanik  identified 
four  key  elements  in  the  scheduler's  process  as  kernels. 

The  kernels  used  to  center  the  development  of  the  final 
DSS  are  listed  in  table  d-‘id. 


Kernels  for  a  DSS  -  '.Pilot  Training  Schedule' 

Instructor  Availability  • 

»  Input  format  for  individual  access 

*  Kelational  data  base  instructor/qualif ications 
Student  Availability  • 

*  Kelational  data  base  instructor/requirements 

*  Sorting  routine  by  requirements 

*  Prerequisite  identifier 

*  (irouping  routine  by  class  and  activity 
Shell  (Dally  schedule  sheet) 

*  Automated  spreadsheet  showing  today's  activit¬ 
ies  based  on  academic  and  flying  schedules. 

a  Data  base  of  Academic  schedule 
«  Data  base  of  available  resources 
(Planes,  Take-off  times,  Kange  times,  Weapon  loads, etc.) 
Student  Instructor  Selection  • 

a  Automated  assignment  routine/expert  system 
which  matches  student  with  activity, 
a  Koutine  which  automatically  updates  the  student 
availability  data  base, 
a  Automated  assignment  routine/expert  system 
which  matches  instructor  with  student. 

*  Koutine  which  automatically  updates  the  instructor 
availability  data  base. 

Alterations  on  Today's  Schedule  * 

a  input  data  of  altered  schedule. 

«  Update  student  and  instructor  data  bases 
a  Update  current  shell 

a  identifies  changes  in  today's  schedule  that 
need  action. 

*  Key  Kernels 


Table  0-2d .  identified  Kernels 


Kor  TACT  7.01,  Command  and  Control,  Capt  Hob  Bivins 
and  i  established  the  system  requirement  lor  a  prototype 
1)SS.  The  only  requirement  from  the  course  was  to  recommend 
the  design  of  a  OSS  that  would  assist  military  decision 
maicers  with  a  command  and  control  issue.  Therefore 
we  decided  to  obtain  the  system  requirements  using  the 
POH  approach  as  described  in  chapter  b. 

The  problem  chosen  was  an  intriguing  look  at  the 
question;  'When  should  a  theater  level  commander  request 
authorization  for  the  use  of  tactical  nuclear  weapons?'. 

Since  no  expert  was  available,  we  conducted  an  extensive 
literature  search  of  the  problem  and  related  issues. 

This  search  plus  our  ten  years  experience  in  strategic 
nuclear  missile  systems,  established  ourselves  as  the 
best  experts  available. 

The  literature  search  revealed  the  existence  of 
plans  requiring  the  NATO  theater  commander  to  ask  for 
the  authority  to  arm  the  weapons  from  the  President. 

The  commander  was  required  to  justify  the  arming  as 

a  necessary  and  politically  feasible  action  at  that 

time  in  the  conflict.  In  other  words,  the  plans  expected 

the  action  to  achieve  battlefield  objectives  without 

having  to  release  the  power.  None  of  the  tactical  employment 

issues  nor  specific  conditions  of  release  were  addressed 

in  this  OSS .  Only  the  collection  of  information  and 


•valuation  of  the  situation  which  would  assist  the  commander 
in  making  and  justifying  the  request. 

Appendix  C  holds  the  final  report  from  the  project. 

All  of  the  concept  maps,  feature  charts  and  storyboards 
are  included.  This  was  the  second  example  of  using 
the  Macintosh  computer  system  with  Mac  Draw. 

d . 70  Conclusion : 

This  chapter  was  designed  to  encourage  other  analysts 
to  use  concept  mapping  and  the  problem  definition  process 
in  their  next  DSS  development.  The  chapter  has  shown 
a  variety  of  decision  support  systems  and  problem  spaces 
where  concept  mapping  and  the  entire  problem  definition 
process  was  applied.  in  every  example  the  problem  space 
was  more  clearly  defined  by  using  the  concept  mapping 
technique.  This  enhanced  understanding  of  the  problem 
space  aided  the  designers  in  their  search  for  the  system 
requirements  and  development  of  a  DSS  prototype.  These 
exercises  have  given  DSS  designers  a  variety  of  examples 
for  the  specific  use  of  concept  mapping  in  problem  definition 
and  kernel  identification. 


Chapter  7 

Application  of  Concept  Mapping  -  RAAP 

7 . 00  Introduction : 

This  chapter  record#  the  experimentation  done  by 
applying  concept  mapping  to  a  very  large  problem  domain. 
Recalling  from  chapter  3,  concept  mapping  can  be  used 
at  any  conceptualization  level.  Thua ,  a  large,  undefined 
or  fairly  new  problem  domain  allows  the  demonstration 
of  concept  mapping  at  a  higher  level  of  conceptualization. 

The  following  discussions  look  at  the  progression 
of  the  experiment  as  well  as  the  findings  and  observations. 
The  first  discussion  explains  why  the  RAAP  problem  domain 
was  chosen  as  a  test  bed  for  concept  mapping.  This 
discussion  lists  the  several  advantages  which  make  RAAP 
ideal  for  the  experiment.  The  second  discussion  looks 
at  the  facts  of  the  experiment.  Included  in  this  section 
are  a  background  on  the  RAAP  concept,  the  set-up  of 
the  experiment,  and  the  procedures  of  Interviewing. 

The  final  discussion  reports  the  findings  and  observations 
by  dividing  them  into  three  categories:  1)  results 
from  individual  mappings,  2)  aggregation  of  group  data 
into  two  maps,  and  3)  the  general  observations  of  the 
experimental  procedure. 

This  chapter  has  two  goals.  The  first  and  most 


obvious  goal  is  to  show  tbs  powtr  of  concspt  mapping 
on  a  rath er  largs  and  nabulous  problem  area.  Quite 
a  bit  of  detail  is  reported  in  the  following  discussions 
on  the  procedure  and  results  of  concept  mapping  in  this 
domain.  Under  both  the  individual  and  the  aggregated 
discussions  are  general  comments  about  the  maps  and 
how  they  were  created.  The  second  goal  is  to  relay 
the  understanding  of  the  RAAP  concept  to  the  reader. 

For  this  reason,  large  amounts  of  time  and  effort  were 
taken  to  redraw  all  of  the  maps.  This  ensures  the  reader 
has  the  most  effective  map  available  from  which  they 
can  learn.  Normally  the  map  would  not  be  formalized 
because  concept  mapping  is  a  working  tool  for  problem 
definition  and  kernel  identification. 

7.10  The  Advantages  of  the  RAAP  Problem  Domain: 

RAAP  was  suggested  during  the  preliminary  thesis 
proposal  discussions  as  a  problem  that  would  be  more 
complex  than  the  DSS  projects.  The  problem  space  did 
reside  in  a  much  higher  conceptual  level.  This  means 
that  the  problem  space  crossed  several  knowledge  domains 
and  utilized  a  variety  of  cognitive  and  decision  processes. 
From  limited  information  on  the  concept,  RAAP  seemed 
to  be  an  interesting  yet  advantageous  problem  domain. 

RAAP  has  several  advantages  for  its  choice  as  the  problem 
domain:  1)  convenience,  2)  size  of  the  problem  domain, 
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3)  lack  of  universal  understanding  of  the  BAAP  concept, 
and  4)  the  need  for  support  of  research  and  development 

goals . 

The  first  advantage  of  BAAP  was  its  convenience. 

APIT  had  already  made  arrangements  for  Col  Bothrock 
to  stake  a  presentation  on  the  concept  of  BAAP.  This 
allowed  immediate  access  to  the  prime  expert  in  the 
field. 

The  second  advantage  is  the  shear  size  of  the  problem 
domain.  BAAP  covers  several  knowledge  domains  and  calls 
for  many  types  of  human  decision  processes  to  be  captured. 

For  example,  the  fusion  of  detailed  battlefield  data 

into  a  complete  picture  of  enemy  actions  requires  collection, 

counting,  judgement  of  accuracy,  collation  of  different 

sources ,  tracking,  and  unit  identification  as  a  few 

of  the  elements  of  the  decision  process.  This  is  just 

one  of  the  many  decision  processes  involved  in  the  BAAP 

concept . 

The  third  advantage  was  the  lack  of  general  under¬ 
standing  about  BAAP  throughout  the  military  establ ishment . 

Col  Bothrock  and  Col  Kline  have  spent  several  hundred 
manhours  briefing  the  concept  of  BAAP.  Many  levels 
of  the  military  and  government  establishments  have  been 
exposed  to  the  'new  way  of  thinking*.  However,  literature 
searches  failed  to  retrieve  anything  significant  that 
described  or  explained  the  BAAP  concept.  This  indicated 
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the  nawntaa  of  the  concept  and  the  lack  of  other  authors 
or  agencies  to  think  about  enacting  or  implementing 
it.  Thus,  it  was  concluded  that  few  people  outside 
of  the  Air  Staff,  a  few  contractors  and  Borne  Air  Develop¬ 
ment  Center  (BADC)  understood  the  concept.  This  lack 
of  universal  under standing  made  RAAP  an  ideal  problem 
domain.  'Experts*  were  much  easier  to  identify  because 
there  were  so  few. 

The  fourth  advantage  is  that  research  supporting 
BAAP  is  just  beginning.  The  engineers  at  BADC  are  looking 
for  additional  support  in  identifying  the  directions 
of  research  and  development  efforts.  (Papagni ,  1987) 

Since  they  are  tasked  with  managing  the  research  for 
the  BAAP  support  systems  and  building  the  demonstration 
prototypes,  they  would  like  to  know  several  things. 

1)  What  part  of  the  system  gets  built  first? 

2)  Why  is  one  element  more  important  than  another? 

3)  Why  do  we  need  this  piece  of  the  puzzle  at  all? 

The  Air  Staff  is  also  interested  in  the  research  goals 
and  the  direction  that  BADC  is  taking.  By  knowing  what 
they  need  in  the  way  of  developments,  they  can  assist 
in  the  management  of  research  and  gaining  financial 
and  political  support. 

In  the  previous  chapter,  there  were  examples  where 
concept  mapping  identified  kernel (s)  for  DSS  projects. 

By  extending  that  process  to  the  larger  domain  where 


several  decision  processes  tales  place,  the  kernel s  identified 
will  be  the  key  decision  processes  and  major  elements 
of  a  decision  process.  This  Identification  process 
will  produce  a  list  of  kernels  for  researchers  to  consider 
as  goals.  Thus,  an  evaluation  system  could  rank  the 
kernels  in  order  of  importance.  A  similar  procedure 
would  be  beneficial  in  the  acquisition  phase  of  a  system 
as  a  statement  of  initial  requirements.  If  concept  mapping 
at  this  level  can  identify  the  kernels,  then  evaluation 
of  the  kernel  can  take  place  and  a  ranked  listing  of 
the  kernels  produced.  This  final  product  becomes  the 
basis  for  the  advocate's  request  for  funding  and  political 
support  (i.e.  a  planning  tool). 

Besides  all  the  advantages  favoring  RAAP  as  the 
test  bed  problem  for  the  concept  mapping  technique  is 
the  fact  that  RAAP  addresses  itself  to  the  field  of 
command  and  control.  There  is  a  great  need  for  understanding 
the  decision  processes  in  command  and  control.  ‘Very 
little  time  or  effort  has  been  spent  uncovering  the 
processes  by  which  command  decisions  are  made;  even 
less  has  been  spent  describing  the  cognitive  operations 
which  decision  makers  perform  when  confronted  with  compli¬ 
cated  and  often  urgent  Ca  problems.*  (Andriole,  1982) 

By  using  the  concept  mapping  technique  of  RAAP  some 
insight  into  the  command  and  control  decision  process 
might  take  place. 


If  this  insight  doss  talcs  placs,  thsn  ths  rsssarch 
sffort  sxpsndsd  on  ths  dsvslopmsnt  of  BAAP  can  talcs 
ths  'decision  malcsr  approach’.  Concspt  mapping  would 
givs  ths  rsssarchsr  ths  visw  of  ths  dscision  procssa 
dirsctly  from  ths  ussr  or  commandsr’s  visw.  Thus,  ths 
dsvslopmsnt  would  bs  built  around  ussr  nssds ,  not  machins 
capabili tiss .  What  is  msant  by  ths  ’dscision  malcsr 
approach'  is  that  ths  command  and  control  systsms  would 
bs  dssignsd  as  supporting  slsmsnts  for  ths  dscision 
procsssss  that  nssd  to  taks  placs.  Andriols  calls  for 
this  approach  as  if  it  wsrs  a  nscsssity.  *Ca  systsms 
ought  to  bs  dssignsd  from  ths  dscision  maksrs  up,  not 
from  ths  slsctronics  capabilitiss  down.*  ( Andriols , 1982) 

Bassd  on  thsss  advantagss  and  nssds,  RAAP  was  chossn 
to  bs  ths  problsm  domain  for  this  tsst  of  concspt  mapping. 
Ons  qusstion  rsmainsd.  It  dsalt  with  ths  procsdurs. 

Was  ths  approach  that  was  ussd  in  ths  DSS  sxamplss  adsquata 
for  this  lsvsl  of  concsptual ization  or  wsrs  changss 
rsquirsd ?  Assuming  ths  basic  procsdurs  outlinsd  in 
chaptsr  ons  would  rssult  in  ths  sams  or  bsttsr  success, 
no  changss  wsrs  mads.  Ths  nsxt  discussion  rscords  the 
experimental  procsdurs  and  ths  adjustments  made. 

7.20  The  Experiment: 

This  is  not  an  experiment  in  the  true  scientific 
sense  of  *a  sequence  of  observations  carried  out  under 
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controlled  conditions*  (Metcalfe,  1908).  The  experiment 
is  a  trial.  Using  the  concept  mapping  technique,  an 
attempt  is  made  to  achieve  two  goals.  The  first  goal 
is  to  identify  key  elements,  kernels,  in  the  decision 
processes  of  BAAP.  The  second  goal  is  to  build  a  map 
that  aids  in  transferring  understanding  between  individuals. 
The  trial  is  not  in  a  controlled  environment.  The  expected 
result  is  an  increased  understanding  in  the  problem 
and  its  decision  process  elements.  Following  is  the 
hypothesis  for  this  experiment: 

’Concept  mapping  conveys  understanding  of  complex 
concepts,  like  BAAP,  between  individuals  and  aids 
in  the  identification  of  kernels.' 

The  measure  of  effectiveness  or  measure  of  degree  of 
accomplishment  is  the  response  from  the  experts  and 
their  eventual  use  of  the  concept  mapping  products. 

In  other  words,  the  best  measure  of  the  success  of  the 
experiment  is  the  value  the  experts  place  in  the  maps 
and  the  list(s)  of  kernels. 

The  main  goal  of  this  trial  session  is  to  see  if 
concept  mapping  can  identify  key  elements  or  kernels 
in  the  BAAP  process.  Before  delving  too  deeply  into 
the  procedures ,  there  is  a  need  for  a  short  discussion 
of  command  and  control  decision  making  and  how  BAAP 
fits  into  the  concept  of  operations  employing  air  power. 


7 . 30  RAAP  -  Background: 


’There  ia  no  adequate  foundation  for  a  theory  of 
command  and  control  and,  htnca ,  no  guiding  principles 
for  ayatam  daaign  and  evaluation*  (Wohl ,  1981:018). 

Thia  was  the  major  finding  of  a  Secretary  of  Defenae 
colloquium  in  1979  on  command  and  control.  Unf ortunately 
little  haa  been  done  to  improve  thia  aituation  aince 
the  Secretary* a  colloquium. 

For  too  long  command  and  control  haa  been  an  art 
form  for  only  a  few  aelect  commanders.  The  effort  to 
educate  and  train  young  officera  a a  akilled  tacticians 
in  applying  air  power  ia  very  weak.  Even  commanders 
in  Europe  at  the  highest  level  of  responsibility  for 
directing  battle  are  not  necessarily  prepared  for  the 
demands  that  command  and  control  require  (Suter,  1987). 
Consequently ,  the  emphasis  in  ektabl iahing  command  and 
control  procedures  and  ensuring  that  those  procedures 
take  full  advantage  of  the  modern  weapon  system's  cap¬ 
abilities  is,  to  say  the  least,  lacking. 

’Western  technology  boasts  a  family  of  new  weapons 
and  reconnaissance/survei 1 lance  systems  with  unprecedented 
capabilities.  7et  command  and  control  of  these  forces 
has  not  kept  pace.  Today  an  operations  decision  maker 
would  be  potentially  deluged  with  target  information 
that  can  describe  and  display  floods  of  eligible  targets 
yet  lacks  an  equivalent  complement  of  explanatory  information 


to  permit  weighing  and  prioritising  those  targets  relative 
to  the  combat  situation  confronting  him.  Without  battar 
davalopmant  and  analysis  of  attack  options,  tha  potancy 
of  tha  air  arm  is  condaomad  to  a  raactiva,  targat  sarvicing 
postura  that  makas  ragaining  tha  initiativa  undar  tha 
amalgam  of  combat  prassuras  virtually  impossibla'  (Bothrock 
and  Klina,  1987:5) . 

What  is  naadad  than  is  a  thaoretical  basis  for 
command  and  control  and  tha  procaduras  to  anact  tha 
thaory.  Wo  hi  insists  that  *...a  thaory  of  command  and 
control  must  start  with  a  thaory  of  dacisionmaking  for 
command  and  control.*  (Wohl ,  1981:018)  In  rasponsa  to 
this  naad  of  a  command  and  control  basis,  cama  tha  concapt 
of  BAAP. 

BAAP  is  a  naw  way  of  daaling  with  tha  information 
flow  on  a  battlafiald  and  tha  support  givan  to  tha  com- 
mandar .  BAAP  offars  a  thaoratical  base  from  which  procaduras 
for  commanding  and  controlling  forcas  ara  darived. 

It  is  a  naw  way  of  thinking  about  tha  air  oparations 
and  application  of  air  powar.  Tha  BAAP  concapt  radafinas 
tha  function  of  command  and  control.  It  harnassas  tha 
powar  availabla  in  information  through  advancad  machine 
capabilitias .  Tha  procaduras  ara  dasignad  around  tha 
naads  of  tha  commander  and  his  decision  processes  by 
managing  and  displaying  information.  Tha  result  allows 
tha  commander  to  taka  advantage  of  preplanned  actions 


and  exploit  the  enemy  weaknesses. 

This  approach  to  command  and  control  fits  very 
well  with  the  conclusion  that  Maj  Orr  finds  in  his  research 
of  Command,  Control,  Communications,  and  Intelligence 
(C*I)  and  combat  operations.  Here  Maj  Orr  offers  a 
definition  of  command  that  parallels  very  well  with 
the  BAA P  concept  of  command  and  control.  ‘The  stochastic 
nature  of  combat  and  the  varying  degree  of  actual  command 
decision  impact  on  the  combat  process  suggest  that  the 
primary  function  of  command  in  combat  is  managing  sources 
of  potential  power  in  order  to  be  able  to  exploit 
opportuni ties  as  they  arise*  (Orr,  1983:47). 

BAAP  finds  further  support  from  Maj  Orr's  definition 
of  control.  He  calls  for  the  need  of  forces  to  exploit 
the  enemy's  weaknesses.  *A  primary  function  of  command 
is  deploying  and  maneuvering  forces  or  other  sources 
of  potential  power  to  be  in  the  best  possible  position 
to  exploit  opportunities  as  they  arise.  This  function 
can  be  viewed  as  controlling  the  power  distribution’ 

(Orr,  1983:51). 

BAAP  is  the  vehicle  in  which  these  definitions 
of  command  and  control  are  realized.  By  implementing 
the  BAAP  concept,  commanders  expect  to  harness  the  true 
power  of  the  weapons  systems  under  their  command,  by 
using  them  more  effectively  (Bothrock  and  Kline,  1987). 


7 . 40  Experimental  Procedure 


The  first  task  was  to  gain  a  basic  understanding 
of  the  concept  RAAP .  The  lack  of  literature  made  this 
a  more  difficult  task  than  the  OSS  projects  worked  on 
earlier.  However,  a  point  paper,  written  by  Col  Bothrock. 
and  listening  to  the  first  lecture  presentation  provided 
the  initial  knowledge  base  to  support  the  interviews. 

Two  appointments  for  interviews  were  set  with  Col 
Bothrock  during  his  visit  to  AF1T.  The  first  interview 
consisted  of  a  short  presentation  about  concept  mapping 
and  its  proposed  value  to  problem  definition.  The  main 
goal  of  the  concept  mapping  exercise  was  stated  as  that 
of  identifying  kernels.  At  that  time  little  was  known 
of  the  extent  of  the  research  and  development  for  BAAP 
nor  of  any  of  the  researcher's  needs.  Col  Bothrock 
participated  in  the  remainder  of  the  session  as  the 
expert.  He  concentrated  on  his  understanding  of  BAAP 
from  a  doctrinal  view.  Much  of  his  understanding  came 
from  an  information  processing  point  of  view.  At  this 
point  in  the  development  of  the  technique,  it  was  assumed 
to  be  a  worthwhile  way  to  approach  the  problem.  This 
approach  changed  later  in  the  development  and  will  be 
reflected  in  later  maps. 

After  both  interviews  and  attending  both  of  Col 
Bothrock 's  presentations ,  several  maps  were  created. 

See  figures  7-2a  through  7-2o.  Col  Bothrock  reviewed 
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a  fan »  of  the  maps  from  the  intarviewa  and  agreed  that 
thay  did  raflact  his  understanding  of  RAAP . 

Col  Bothrock  fait  strongly  that  concapt  mapping 
had  significant  valua.  Ha  providad  tha  funds  which 
anablad  a  complata  sat  of  concapt  maps  to  ba  ganaratad 
from  all  tha  kay  axparts  in  tha  fiald.  This  ganarosity 
providad  tha  opportunity  for  a  mora  axplicit  definition 
of  tha  problem  and  mora  concise  identification  of  the 
kernels.  However  tha  approach  with  tha  interviews  had 
to  change  slightly. 

In  tha  interim  between  tha  first  mapping  of  Col 
Bothrock  and  tha  mapping  of  tha  other  axparts ,  it  became 
obvious  that  a  complata  separation  of  problem  definition 
and  decision  processes  had  to  taka  place.  Defining 
a  problem  with  regards  to  tha  process  does  not  result 
in  as  axplicit  a  definition  for  tha  problem  space. 
Therefore,  whan  tha  other  BAA?  axparts  ware  approached^ 
thay  ware  told  that  two  sessions,  of  about  an  hour  each, 
would  ba  required.  Tha  first  session  would  concentrate 
on  their  understanding  of  tha  problem,  while  tha  second 
session  would  emphasize  how  thay  would  solve  the  problem 
or  make  tha  decision.  Tha  interviewing  procedure  outlined 
in  chapter  4  was  followed.  The  maps  produced  from  each 
expert  were  labeled  as  either  definition  or  process 
maps  depending  on  the  interview's  approach.  These  multiple 
maps  gave  the  experiment  much  more  latitude  with  which 


to  work. 


With  the  multiple  maps  from  various  sxpsrts ,  ths 
•xpsrimsnt  sxpandsd  significantly.  Tasting  sons  of 
ths  various  bslisfs  about  concspt  mapping  could  now 
bs  accomplished.  Thsrs  would  bs  multiple  maps  of  several 
experts  to  aggregate  into  the  overall  problem  definition 
and  decision  process  maps.  This  would  show  if  there 
are  consistent  repeatable  elements  that  identify  as 
kernels.  These  kernels  were  finally  identified  by  a 
process  called  'overlaying  maps'. 

7 . 50  Findings  and  Observations : 

This  discussion  is  broken  into  three  separate  parts. 

The  first  part  is  a  report  of  the  concept  mapping  exercise 
as  it  took  place  with  the  individual.  This  portion 
identifies  the  individual's  role  and  expertise,  addresses 
any  changes  to  the  normal  experimental  procedure,  and 
finally  shows  and  comments  on  the  individual’s  concept 
map(s) .  For  some  of  the  interviews,  several  maps  were 
created.  The  multiple  maps  come  from  the  expert’s  desire 
to  delve  into  topic  areas  in  great  detail  and/or  several 
topics.  Each  map  is  introduced  and  key  items  of  interest 
are  noted. 

The  second  part  of  this  section  looks  at  results 
of  the  aggregation  process.  All  maps  created  during 
this  exercise  are  divided  into  two  groups:  problem  definition 


or  decision  process.  The  key  concepts  ere  identified 
from  each  ares.  This  list  of  concepts  are  the  concepts 
that  seem  to  be  universally  held  by  the  majority  of 
experts.  The  identification  is  the  author’s  understanding 
and  perception  gained  from  all  the  interviews  and  readings. 
From  the  definition  list  an  ’aggregated’  map  is  constr¬ 
ucted.  The  aggregated  problem  definition  map  of  RAAP 
is  the  author’s  perception  and  has  not  been  fully  verified 
by  the  experts.  Instead,  the  map  is  shown  as  a  demonstrati 
of  the  technique  to  transfer  tinderstanding  through  concept 
mapping.  The  aggregated  map  shows  the  identification 
of  the  key  concepts,  and  the  links  between  concepts 
that  create  understanding. 

The  third  section  reports  some  of  the  observation 
noted  about  the  concept  mapping  process.  Interesting 
facts  and  findings  from  the  exercise  are  listed. 

7.51  Individual : 

Headings : 

The  first  concept  map  was  created  from  the  point 
paper  obtained  from  Col  Hothrock.  This  map  was  created 
so  that  the  author  could  gain  a  better  understanding 
of  the  concept  RAAP .  This  preparation  is  an  important 
first  step  in  the  process  of  concept  mapping  (Figure 


RAAP 


Col  Bothrock: 


Col  Bothrock  is  the  commander  of  INYX  on  the  Air 
Staff,  Headquarters,  USAF ,  Pentagon.  This  office  is 
responsible  for  the  development  of  USAF  intelligence 
doctrine.  He  is  one  of  the  initiators  of  the  concept 
BAAP.  His  organization  is  the  office  of  co-responsibility 
for  the  development  of  BAAP. 

A  detailed  series  of  concept  maps  were  constructed 
from  his  two  presentations  to  AFIT  classes  and  the  many 
interviews  with  Col  Bothrock  .  Each  of  these  maps  are 
shown  in  figures  7-2a  through  7-2k.  Each  of  the  maps 
are  individually  introduced  and  comments  provided  below. 

Presentations  -  Figures  7-2a  and  7-2b  are  the  concept 

maps  of  his  presentations  to  the  TACT  4.12  'Strategic 
and  Tactical  Sciences  Seminar*  and  TACT  7.01  'Command 
and  Control*  classes. 

Both  of  the  Colonel's  maps  were  created  from  audio 
tape  recordings  of  the  presentation  as  well  as  class 
notes  and  copies  of  the  slides.  Both  maps  are  considered 
to  be  independent  expressions  of  the  BAAP  problem  space 
because  Col  Bothrock  approached  the  presentation  differently 
due  to  the  different  make-up  of  the  audiences.  Consequently, 
he  emphasized  different  key  points  of  BAAP.  These  two 
views  of  the  problem  space  gave  maps  that  had  the  same 
key  concepts  but  at  different  levels  of  importance. 


Figure  7- 2a.  Col  Rothrock ' s  Presentation  to  TACT  412 


This  was  an  axcallsnt  example  of  the  'rubber  sheet' 
characteristic  of  concept  maps. 

First  interview  -  Figures  7-2c  and  7-2d  are  the  two 
maps  created  during  the  first  interview. 

The  first  mapping  session  began  by  having  Col  Bothrock 
list  the  key  or  universal  problem  areas  addressed  by 
BAA?.  The  Oth  area,  that  of  event  targeting,  was  further 
expanded  during  the  session.  The* resulting  map  is  shown 
in  figure  7-2c.  The  second  map  was  Col  Bothrock 's  view 
of  the  process  BAAP  would  take  to  make  decisions.  This 
map  began  to  show  some  of  the  Simple  elements  of  the 
many  decision  processes.  These  decision  process  elements 
became  more  evident  in  later  maps  from  Col  Bothrock 
and  others . 

Second  interview  -  Figures  7-2e  through  7-2J  are  the 
maps  used  and  created  by  the  second  interview. 

The  second  interview  was  a  smorgasbord  of  issues 
revolving  around  the  concept  BAAP.  The  first  discussion 
started  by  reviewing  a  concept  map  made  during  the  second 
presentation  as  lecture  notes  (See  figure  7-2e) .  The 
discussion  started  by  looking  at  BAAP  as  a  process  of 
information  management.  From  the  view  of  intelligence 
functions,  the  user  is  expected  to  follow  a  procedural 
framework.  This  framework  is  called  the  *by  exception 
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Figure  7-2c.  First  Interview:  Problem  Areas 


Fiqure  7-2d.  RAAP  Process 
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approach*  which  is  a  management  through  deduction  process. 
These  concepts  were  added  to  the  map  and  is  shown  in 
figure  7-2f.  Further  discussions  on  the  management 
of  risk  and  level  of  command  where  also  discussed  and 
added . 

The  interview  then  evolved  into  an  extensive  discussion 
on  technological  evolution  and  how  RAAP  would  take  advantage 
of  future  developments.  In  response  to  the  detailed 
information  given  by  Col  Rothrock,  several  detailed 
maps  were  created  showing  the  understanding  between 
RAAP  and  other  concepts. 

The  four  maps  address  separate  relationships  of 
RAAP  and  the  following  concepts.  Figure  7-2g  depicts 
the  colonel's  understanding  of  a  seventh  problem  area 
in  RAAP.  western  advantage.  This  problem  area  points 
out  the  lack  of  the  west's  ability  to  take  advantage 
of  their  technological  advances  because  of  the  lack 
of  conceptual  understanding  of  their  application.  Figure 
7-2h  shows  how  RAAP  uses  technology.  The  concept  RAAP 
is  a  thought  process  that  can  be  done  without  any  tech¬ 
nological  support.  An  example  of  using  a  RAAP-like 
approach  is  the  Army’s  Commander's  Estimate  of  the  Battle¬ 
field.  However,  RAAP  prescribes  the  need  for  technological 
application  when  it  is  available.  Figure  7-2i  debates 
inductive  and  deductive  thinking  and  how  RAAP  uses  them. 

One  analogy  to  understand  the  difference  between  inductive 


-2f.  Second  Interview 


and  deductive  thinking  is  tha  fabla  of  tha  savan  blind 
man  and  tha  alaphant.  Each  man  inspacts  his  part  of 
tha  alaphant.  Ha  makas  his  idantif ication  basad  on  tha 
part  of  tha  alaphant  ha  inspacts.  This  is  an  axampla 
of  tha  inductive  procass.  If  all  tha  man  would  compara 
thair  findings  and  dascriba  tha  alaphant  in  tarms  of 
aach  finding  than  thay  would  ba  daducing  tha  actual 
dascription.  Finally,  figura  7-2j  comparas  currant 
thinking  to  tha  way  BAA?  wants  tha  usar  to  think. 

Tha  sacond  intarviaw  continuad  with  discussions 
on  a  variaty  of  issuas  daaling  with  tha  davalopmant 
and  application  of  BAAP.  Soma  of  thasa  issuas  includad: 

1)  tha  laval  of  command  and  control,  and  2)  tha  political 
factors  involvad.  Ona  of  tha  discussions  cantarad  on 
tha  statamant,  what  BAAP  is  not.  Soma  of  thasa  discussions 
a ra  dapictad  in  figuras  7-2k  and  7-21. 

Aftar  tha  two  intarviaws  and  his  limitad  raviaw 

of  tha  initial  maps,  Col  Rothrock  praisad  tha  process 

as  vary  halpful  for  tha  axpart.  'This  is  a  vary  good 

approach.  It  forces  me  to  deal  with  and  define  tha 

issuas  in  ways  that  I  probably  would  not  have  dona  on 

my  own.*  (Rothrock,  1987b)  Thus,  concept  mapping  helped 

* 

tha  axpart  to  deal  with  organizing  his  understanding 
of  tha  concepts.  If  this  exercise  helps  in  organizing 
tha  expert’s  understanding,  than  concept  mapping  captures 

his/her  best  understanding  of  the  concepts  at  that  time. 
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Figure  7-21.  RAAP  is  Not 


Third  interview  -  After  approximately  10  weeks ,  Col 
Bothrock  was  interviewed  again.  The  interview  started 
with  the  review  of  the  maps  shown  in  figures  7-2a  and 
b.  This  interview  had  several  detailed  discussions 
revolving  around  misrepresentation  from  these  maps. 

Col  Bothrock  checked  the  maps  for  two  items.  First 
he  was  asked  to  check  the  maps  for  areas  of  misconceptions 
or  misrepresentation .  This  included  improper  terms 
used  for  concepts  and  illogical  or  wrong  linkages  between 
these  concepts.  He  agreed  with  the  basic  concepts  and 
their  linkages  in  both  maps. 

Col  Bothrock  was  next  asked  to  check  the  maps  for 
missing  concepts  or  linkages.  He  did  have  some  additions 
to  make  to  the  maps.  These  additions  are  shown  in  figure 
7-2m  and  7-2n.  The  last  exercise  Col  Bothrock  performed 
was  an  attempt  to  link  all  previous  maps  together. 

The  result  is  shown  in  figure  7-2o. 


Additions 


Maj  Harrison  is  an  intelligence  officer  assigned 
to  INYX.  Hs  has  sxtsnsivs  sxpsrisncs  in  the  operational 
intelligence  field.  His  point  of  view  is  that  of  the 
intelligence  user.  Two  questions  drive  much  of  Maj 
Harrison’s  thinking  and  were  brought  out  in  his  map: 

1)  Which  intelligence  functions  will  RAAP  perform? 

2)  How  will  RAAP  support  the  intelligence  functions 
required  in  a  battle? 

Only  one  formal  interview  session  was  available 
due  to  time  constraints.  The  approach  taken  with  Maj 
Harrison  was  the  two  step  approach.  The  problem  definition 
was  emphasized  in  the  first  part  of  the  interview  while 
the  second  part  concentrated  on  the  decision  process. 

He  defined  the  problem  space  in  terms  of  the  process. 

This  gave  the  experiment  a  new  twist  since  one  map  would 
be  considered  in  both  definition  and  process. 

Maj  Harrison’s  map  is  shown  in  figure  7-3.  If 
one  takes  the  time  to  read  his  map,  both  his  understanding 
of  the  concept  and  the  decision  process (es)  of  RAAP 
come  through  clearly. 


Col  Kline: 


I 

Col  Kline  is  the  commander  of  XOXID  on  the  Air 
Staff,  Headquarters  USAF ,  Pentagon.  XOXID  develops 
the  doctrine  that  guides  the  application  of  tactical 
air  power  for  the  USAF.  He  is  Col  Rothrock's  co-initiator 
of  the  RAAP  concept.  His  organization  holds  primary 
responsibility  for  the  development  of  RAAP. 

Unfortunately,  due  to  time  constraints,  only  one 
interview  was  scheduled.  Since  Col  Kline's  expertise 
is  in  tactical  doctrine,  the  interview  was  centered 
around  his  understanding  of  the  RAAP  concept.  In  other 
words,  the  interview  sought  his  definition  of  the  problem. 

The  map  is  shown  in  figure  7-4. 


Mr  John  Allen: 


Mr  Allen  is  the  expert  in  Soviet  maneuver.  He 
is  expected  to  determine  the  profiles  needed  to  predict 
the  red  intent  from  the  functional  order  of  battle  and 
the  events  taking  place. 

The  interviews  with  Mr  Allen, followed  the  standard 
procedures .  The  first  interview  concentrated  on  his 
understanding  of  the  problem.  The  second  interview 
attempted  to  capture  his  understanding  of  the  decision 
processes  of  RAAP . 

The  first  map,  figure  7-5a,  shows  his  definition 
of  BAAP.  Figure  7-5b  is  the  map  from  the  second  interview 
showing  the  decision  processes  according  to  Mr  Allen. 


Mr  Converse: 


Mr  Converse  was  chosen  to  be  an  expert  because 
of  his  position  as  a  research  manager  over  the  RAAP 
effort.  He  is  a  physical  scientist  at  RADC ,  Croup  Leader 
and  Manager  of  the  Advanced  Sensor  Exploitation  Section. 

Again  due  to  time  constraints,  only  one  interview 
was  scheduled.  The  interview  followed  the  standard 
two  part  approach  of  trying  to  capture  the  problem  definition 
and  decision  process. 

The  resulting  map  is  shown  in  figure  7-0.  This 
map  is  different  than  any  of  the  previous  maps  in  that 
both  problem  definition  and  decision  process  are  on 
the  same  map.  This  was  done  to  save  space  and  to  show 
the  level  of  conceptualization.  In  this  interview  the 
level  of  conceptualization  was  not  as  detailed  as  with 
other  experts.  The  map  has  two  halves.  The  left  half 
is  Mr  Converse's  understanding  of  the  problem,  or  his 
problem  definition.  The  right  side  is  his  understanding 
of  the  decision  processes. 


Converse's  Concept  Map 


Mr  Papagni : 

Mr  Papagni  is  the  RAAP  program  manager  for  Rome 
Air  Development  Center  (RADC) .  Currently  he  is  the 
individual  responsible  for  the  majority  of  RAAP  research 
and  research  management  in  the  Air  Force. 

His  interviews  consisted  of  both  the  problem  definition 
and  the  decision  process.  The  maps  constructed  from 
these  two  interviews  are  shown  in  figures  7-7a  and  7-7b. 

Lt  Fye : 

Lt  Fye  is  also  an  engineer  that  is  working  on  research 
dealing  with  tactical  sensor  fusion  of  battlefield  data. 

This  type  of  research  is  in  direct  support  of  the  type 
of  technological  applications  that  RAAP  can  exploit. 

Lt  Fye's  interview  centered  on  his  understanding  of 
the  RAAP  concept.  His  map  is  shown  in  figure  7-8a. 

Like  Mr  Papagni ,  Lt  Fye  also  approaches  the  concept 
like  an  engineer.  He  sees  it  as  a  ‘God’s  eye  view* 
collection  of  data  by  various  sensors  that  feed  into 
data  bases  and  processors.  He  sees  the  output  as  recom¬ 
mendations  and  basic  information  for  the  user  to  consider. 
These  comments  are  expressed  in  his  second  map  shown 
in  figure  7-8b.  This  map  also  shows  insight  into  his 
understanding  of  the  concept  RAAP  and  its  processes. 


Figure  1-la.  Papagni :  Definition  of  RAAP 


Col  Moody  Suter  (Retired) : 

Col  Suter  is  a  retired  Air  Force  Officer  who  is 
now  a  consultant  to  E-Systems,  the  prime  contractor 
for  phase  I  research  related  to  RAAP.  He  is  considered 
by  the  Air  Staff  as  the  expert  in  application  of  modern 
air  power  against  highly  maneuverable  Soviet  ground 
forces . 

Approximately  four  hours  of  interviews  were  held 
with  Col  Suter.  The  same  approach  was  used  on  Col  Suter 
as  on  the  other  experts:  to  capture  first  his  understanding 
of  the  concept  RAAP  and  secondly  the  decision  processes 
as  he  sees  them.  Col  Suter ’s  maps  are  listed  in  figures 
7-9a  and  7-9b. 

Figure  7-9a  is  the  map  Showing  Col  Suter’ s  understanding 
of  RAAP.  He  has  centered  it  around  the  battle  commander 
and  his  responsibilities .  The  second  map  is  very  inter¬ 


esting.  This  map  is  the  process  Col  Suter  sees  as  the 
battle  commander’s 

process  and  the  interface  that  commander  would  have 


with  a  RAAP  system.  It  is  constructed  in  a  time-line 
fashion.  The  center  line  depicts  the  progression  of 
time  as  a  commander  interfaces  with  the  decision  processes 
and  decision  aids.  Thus,  the  decision  processes  of 
RAAP  are  captured  by  looking  at  the  entire  decision 


processing  of  the  human. 
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Figure  7-9a.  Col  Suter :  RAAP  Definition 


7.52  Aggregation : 


This  section’ s  main  purpose  is  to  summarize  the 
lessons  learned  about  BAAP .  The  procedure  used  is  that 
outlined  in  chapter  3  called  Overlaying  Maos.  The  results 
of  this  process  are  described  below. 

The  aggregation  process  was  done  twice.  The  first 
effort  concentrated  on  the  definition  of  BAAP.  The 
key  elements  of  the  definition  of  BAAP  are  listed  in 
Table  7-1.  From  these  key  concepts,  the  aggregated 
concept  map  was  created  to  depict  this  author's  definition 
of  BAAP.  This  map  is  shown  in  Figure  7-10.  This  map 
was  created  as  a  demonstration  that  a  transfer  of  under¬ 
standing  did  take  place  between  the  various  experts 
and  the  author. 


Inf ormation 

Way  of  Thinking 

Proaction 

Deductive  Thinking 

Information  Technology 

Human  Judgment 

Logic 

Decision  Making 
Decision  Aids 

Table  7-1.  Key  Concepts  in  the  Definition  of  BAAP 


The  aggregation  process  was  reapplied  to  the  decision 
processes  of  BAAP.  Table  7-2  lists  the  key  elements 
identified  from  the  BAAP  decision  process  maps  as  possible 
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kernels.  These  kernels  are  the  area*  of  present  and 
future  research  that  will  support  tha  development  of 
HAAF .  Tha  main  purpose  for  this  list  of  kernels  is 
in  avaluation  of  raaaarch  goal*,  diraction  of  rasaarch 
afforta  and  gaining  support  from  outsida  agancias. 

This  list  of  karnals  is  not  intandad  to  ba  axhaustiva. 

It  is  only  a  suggestion  or  starting  point  for  tha  axparts 
and  kay  rasaarch  managers.  Hopefully,  this  list  will 
confirm  soma  of  tha  axparts*  intuitive  feelings  about 
tha  diraction  of  tha  on-going  rasaarch  efforts.  Tha 
list  should  also  initiate  discussion  on  karnals  that 
may  not  have  bean  previously  considarad  or  acted  upon. 

Mo  aggregated  map  was  constructed.  An  aggregated 
map  of  tha  decision  process  would  not  serve  any  useful 
purpose  at  this  time.  The  reasons  for  this  decision 
ara  based  on  tha  main  purpose  for  this  paper  and  tha 
lack  of  beneficial  use  to  tha  expert s.  It's  believed 
that  tha  axparts  will  gain  more  from  using  all  the  individual 
mappings  of  tha  decision  processes  and  the  list  of  suggested 
karnals.  Prom  these  resources  tha  individual  rasaarch 
groups  can  develop  their  own  aggregated  maps  of  the 
decision  process  and  identify  the  key  elements  based 
on  their  perceptions.  Du*  to  the  infancy  of  the  research, 
a  broad  view  of  the  possible  decision  approaches  is 
needed  so  research  efforts  are  not  stifled  by  single 
views . 
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Information  Processing 

-  Collection  of  Information 

■  Who  or  what  manage*  the  data  collection  equipment 
and  procedure*? 

*  What  i*  the  specific  information  that  get* 
collected? 

*  Who  or  what  mechanism  select*  information 
to  collect? 

*  How  is  the  information  ranked? 

■  What  are  the  ‘rules*  for: 

1)  collecting  the  information 

2)  identifying  pertinent  information 

3)  ranking  the  information 

4)  eliminating  the  information 

-  Collation  of  information 

a  What  are  the  ‘rules*  for: 

1)  combining  information 

2)  establishing  meaning  to  individual 
pieces  of  information 

3)  not  combining  information 

-  Fuser 

■  What  are  the  ‘rules*  for: 

1)  drawing  meaning  from  raw  and  collated 

data 

2)  ranking  the  fused  information 

3)  presenting  fused  information  (order) 

■  Where  does  the  information  get  fused? 

(central  vs  local) 

■  Who  gets  fused  information? 

-  Displays 

*  How  will  the  data  (raw,  collated,  fused) 
be  displayed? 

■  Who  will  get/control  the  display? 

■  How  will  the  Battle  CC  get  the  information? 

-  Data  Base  Interface 

*  Who  or  what  controls/maintains/accesses? 

*  What  are  the  ‘rules'  to  control/maintain/access? 

Red  Inference  Engine 

-  Profiles 

*  What  are  the  ‘rules'  for: 

1)  matching  current  events  with  past  actions? 

2)  handling  the  uncertainty? 

3)  ranking  the  importance  of  the  predicted 
actions? 


Table  7-2.  Possible  Kernel*  in  the  RAAP  Process 
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BED  Inference  Engine  (Continued) 

-  Data  But  of  Events 

*  Who  or  what  will  maintain/control/access 
this  volatile  data  base? 

■  Bow  will  the  CC  maintain  knowledge  of  data? 

■  How  will  the  CC  access/display  logic  for 
prediction  based  on  intelligence?' 

-  Oppor trinities  Identifier 

»  Who  or  what  will  notify  the  CC? 

«  How  will  the  CC  be  notified? 

•  Integration  of  Opportunities/Options/Intelligence, 
how  will  they  be  displayed/managed/communicated? 


BLUE  Inference  Engine 

-  Data  Base  of  Actions-to-Take 

■  who  or  what  will  maintain/control/access 
this  volatile  data  base? 

■  How  will  the  CC  maintain  knowledge  of  data? 

■  How  will  the  CC  access/display  logic  for 
prediction  based  on  intelligence/Predicted 

BED  action/Besources? 

•  Integration  of  Besources  and  BLUE  options? 

-  Weaponeering 

«  Optimization  of  Force  -  based  on: 

1)  Weapons  available 

2)  Tactics 

3)  Target  characteristics 

4)  Survivability 


“What-If * 


Who  will  control  the  function? 

What  functions  will  be  contained? 

1)  War  Gaming 

2)  Simulation 

3)  Other  Optimization  and  Gaming  Models 
How  will  functions  interact  with  the  current 
information  available  in  the  system? 

Display  of  results? 

Who  manages/control/access  displays? 

How  do  results  from  'What-If*  integrate  with 
actual  data  displays? 


Table  7-2. 


Possible  Kernels  in  the  RAAP  Process 
(Continued) 
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7.53  Observations : 

The  following  discussion  is  a  rscord  of  various 
observations  mads  during  the  process  of  preparing  the 
concept  maps  on  RAAP.  All  of  these  observations  support 
the  concept  map  as  a  powerful  communications  tool. 

Three  observations  are  made  based  on  the  fact  that 
each  expert  brings  a  different  perception  of  RAAP  into 
the  interviews.  Throughout  all  of  the  mapping  exercises, 
one  thing  became  very  clear.  The  experts  defined  RAAP 
in  terms  of  their  specific  backgrounds  and  from  their 
perspective.  Experts  approach  the  problem  based  on 
their  backgrounds .  Col  Rothrock  looked  at  it  from  the 
theoretical  level  of  information  processing.  Mr  Papagni , 

Mr  Converse  and  Lt  Fye  centered  their  discussions  around 
the  process  and  the  hardware.  Col  Kline's  view  was 
from  operation's  need  for  support  in  information  processing 
and  the  advantage  of  RAAP  in  this  problem  domain.  Maj 
Harrison's  point  of  view  came  from  the  operational  intel¬ 
ligence  field.  He  was  very  concerned  about  how  RAAP 
would  Interface  intelligence  with  operations  and  accomplish 
the  intelligence  functions.  Mr  Allen  took  a  totally 
different  view  by  describing  RAAP  as  a  planning  system 
that  is  mission  driven.  This  makes  perfect  sense  since 
Mr  Allen  is  the  Soviet  expert  and  deals  in-depth  with 
the  mission  assessment  portion  of  RAAP.  Finally,  Col 


Suter  took  the  approach:  'If  I  war*  tha  commander,  how 
would  I  want  tha  decision  aid  to  support  me?*  (Sutar, 

1987)  . 

From  these  varied  perceptions  come  the  first  obser¬ 
vation.  It  recognizes  the  fact  people  do  have  differences, 
but  still  the  series  of  maps  show  a  high  level  of  conceptua 
agreement.  This  phenomenon  demonstrates  that  a  universal 
understanding  of  basic  BAAF  concepts  does  exist  among 
the  experts . 

The  second  observation  substantiates  the  basis 
of  the  overlay  process.  The  many  perceptions  produced 
a  variety  of  maps  which  emphasize  different  parts  of 
the  RAAP  concept,  but  each  expert  identified  most  of 
the  same  basic  concepts.  This  made  the  overlaying  of 
maps  an  easy  process .  When  most  of  the  experts  agree 
on  the  basic  concepts  and  link  them  in  similar  manners, 
confidence  is  high  that  that  concept  is  key. 

The  final  observation  made  from  the  variety  of 
perceptions  deals  with  the  transfer  of  understanding 
to  others.  Difference  in  background  and  development 
of  thought  patterns  do  not  alter  the  transfer  of  under¬ 
standing.  Linkages  may  be  different  and  organization 
of  the  concepts  may  be  radical  from  map  to  map  but  the 
basic  understanding  of  the  concept  still  comes  through. 

For  example,  contrast  the  maps  of  Mr  Papagni  and  Col 


Rothrock . 


The  strong  background  of  scientist/ engineer  produces 
a  set  of  maps  that  show  the  powerful  influence  of  systemati 
analysis  and  process.  Especially  noteworthy  is  the 
way  Mr  Papagni  described  the  process.  He  has  it  organized 
in  his  mind  as  a  flow  of  inputs,  data  bases ,  processors , 
and  outputs.  This  approach  is  quite  different  from 
that  of  Col  Rothrock.  Yet,  the  overall  concept  of  RAAP 
is  the  same  and  many  of  the  linkages  reflect  similar 
understandings.  The  educational  value  of  both  sets 
of  maps  for  the  novice  reader  enhances  the  transfer 
of  information  and  eventual  understanding . 

Finally,  one  noteworthy  incident  was  observed  that 
supports  the  value  of  the  maps  as  communications  tools 
and  transfers  of  understanding.  After  completing  the 
second  interview  with  Mr  Allen,  Maj  Harrison  entered 
the  room  and  looked  at  the  map  that  was  still  on  the 
board  from  the  interview.  Maj  Harrison  was  able  to 
quickly  read  and  identify  a  mistaken  concept  Mr  Allen 
had  of  the  Air  Tasking  Order  (ATO) .  After  a  few  questions 
and  some  explanations,  Maj  Harrison  suggested  changes 
in  the  map  that  would  more  correctly  depict  the  function 
of  the  ATO  in  managing  assets. 

This  incident  substantiated  two  propositions  of 
the  concept  mapping  technique.  First  the  incident  showed 
the  ease  of  readability  that  is  inherent  in  a  concept 
map.  Maj  Harrison  could  easily  read  and  pick  out  the 


understanding  depicted  by  the  map.  This  action  of  Maj 
Harrison  is  evidence  that  a  transfer  of  understanding 
took  place.  Secondly,  it  showed  that  two  individuals, 
having  different  beliefs  about  a  concept,  could  quickly 
identify  and  discuss  the  issue  by  reviewing  the  map. 
After  an  agreement  is  reached,  appropriate  changes  to 
the  map  occur  which  shows  the  corrected  understanding. 

These  were  just  a  few  of  the  many  observations 
made  that  support  the  power  of  concept  mapping  as  a 
communications  tool. 


7 . 80  Conclusion : 

This  chapter  has  recorded  the  application  of  concept 
mapping  to  a  large  problem  area.  Its  goals  were  to 
bring  about  a  transfer  of  understanding  about  the  basic 
concept  and  to  help  identify  key  decision  elements  in 
the  various  decision  processes.  The  chapter  explained 
why  RAAP  was  chosen  as  the  test  bed  problem  area  and 
gave  some  background  as  to  why  the  USAF  is  very  interested 
in  RAAP.  The  experimental  procedure  was  outlined  and 
results  reported  in  detail  along  with  the  entire  series 
of  concept  maps. 


In  conclusion,  this  experiment  has  shown  that  concept 
mapping  can  act  as  an  aid  to  pick  out  key  kernels,  help 
enhance  understanding  between  individuals  and  do  these 
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8.00  Introduction : 

This  chapter  discusses  the  overall  findings  and 
results  obtained  from  applying  concept  mapping  to  the 
task  of  problem  definition  and  kernel  identification. 
Based  on  these  comments,  recommendations  for  future 
research  with  concept  mapping  is  presented  for  the  technique 
development  and  application.  Recommendations  are  also 
presented  for  the  future  work  yet  to  be  done  on  RAAP 
and  where  concept  mapping  may  assist. 

8.10  Findings  and  Results: 

The  main  objective  of  this  research  effort  was 
to  develop  a  user  oriented  tool  (concept  mapping)  for 
problem  definition  and  kernel  identification  during 
the  design  phase  of  a  DSS.  The  second  objective  was 
to  develop  a  procedure  for  using  this  tool  in  the  adaptive 
design  approach.  The  two  sections  below  record  the 
findings  and  observations  from  each  of  these  objectives. 

8.11  Concept  Mapping  as  a  Tool; 

Through  the  observations  made  during  the  many  exper¬ 
iments,  the  findings  can  be  broken  down  into  five  separate 
areas .  First,  concept  mapping  demonstrated  its  ability 
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to  transfer  understanding  between  individuals.  This 
was  especially  noteworthy  where  more  than  one  person 
was  involved  in  the  construction  of  the  DSS  or  defining 
the  problem.  The  fact  that  concept  maps  transfer  under¬ 
standing  is  also  why  they  are  an  excellent  teaching 
tool  in  education. 

The  second  finding  is  that  concept  maps  identify 
inconsistencies  and  misconceptions .  If  a  person  is 

erratic  in  his/her  explanation  of  the  problem  by  using 
different  concepts  and  illogical  or  multiple  links, 
then  these  inconsistencies  are  readily  seen  in  the  maps. 
The  person  can  then  concentrate  on  the  actual  meaning 
and  form  the  proper  understanding .  In  other  words, 

the  expert  stabilizes  the  meaning.  If  in  a  group  setting, 
one  of  the  members  has  a  misconception  about  some  part 
of  the  problem,  it  will  be  seen  by  the  others  on  the 
concept  map.  The  members  can  then  help  the  individual 
attain  the  correct  understanding  and  eliminate  the  mis¬ 
conception. 

The  third  and  fourth  findings  are  the  most  important. 
Basically,  concept  mapping  works.  It  is  shown  in  the 
many  examples  presented  in  this  paper  that  the  concept 
maps:  1)  capture  a  human’s  understanding  of  a  specific 

problem  space  and  2)  capture  his/her  decision  process 
elements.  This  process  can  produce  a  reasonably  complete 
description  of  the  problem  space.  It  creates  both  a 


perceived  definition  of  the  problem  and  a  list  of  tasks 
and  events  that  make  up  the  individual's  perception 
of  the  decision  process.  Understanding  depicted  in 
these  maps  is  easily  transferred  to  others  by  'negotiating 
the  meaning’. 

The  last  finding  is  the  forum  for  'negotiating 
the  meaning'  that  concept  mapping  provides  to  the  DSS 
design  team.  Concept  mapping  provides  a  forum  for  discussion 
and  evaluation.  Using  the  concept  maps  to  capture  their 
understanding  of  the  problem  space  and  elements  of  the 
decision  process  gives  an  easy-to-read  format  that  is 
simple  to  manipulate  as  perceptions  change.  The  design 
team  members  identify  and  rank  the  *  importance"  of  the 
elements  in  the  decision  process.  Once  they  have  the 
rankings  and  initial  system  requirements ,  evaluation 
criteria  can  be  developed  to  ensure  the  design  supports 
the  kernels. 

8.12  The  PDP  as  an  Integrator: 

Three  key  observations  were  made  f?om  the  two  exper¬ 
iments  using  the  PDP  approach.  First,  the  designers 
had  an  orderly  approach  to  guide  them  through  the  analysis 
and  design  phases  of  the  adaptive  design.  Each  time 
they  complete  a  step  or  an  evaluation  in  the  PDP.  the 
next  action  was  clearly  identified.  Second,  the  criteria 
for  the  evaluation  of  the  system  requirements  were  much 
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easier  to  derive.  The  avaluation  had  a  purpose:  the 
naad  to  support  cognitive  processes  which  ware  described 
by  tha  concept  maps.  The  avaluation  also  had  guidance. 

The  guidance  came  from  tha  kernels  identified  as  tha 
key  decision  elements  that  required  the  support  of  the 
DSS.  Thus  the  criteria  derived  ensured  the  system  design 
supported  the  cognitive  process  and  was  built  around 
the  key  kernel (s) . 

The  last  observation  was  the  increased  confidence 
the  design  team  members  had  on  the  system  requirements. 
Using  the  PDP  enhanced  the  design  of  the  system  to  support 
the  cognitive  processes  of  decision  making.  The  concept 
mapping  tool  aided  in  the  identification  of  the  kernels. 

The  feature  charts  and  storyboards  developed  the  system 
requirements  based  on  the  kernels  identified  and  the 
evaluation  kept  the  design  on  the  right  track.  All 
three  steps  made  for  a  set  of  initial  system  require¬ 
ments  that  were  believed  to  describe  a  DSS  that  really 
did  support  the  decision  maker. 

The  examples  and  personal  experience  of  the  author 
led  to  the  belief  that  the  Problem  Definition  Process 
is  a  viable  method  of  developing  and  maintaining  the 
system  requirements  of  an  evolving  DSS.  The  steps  contained 
in  the  three  phases  of  the  PDP  have  produced  two  interesting 
and  successful  designs  and  prototypes.  The  more  DSS 
designers  experiment  and  work  with  the  order  and  iteration 


of  the  stops,  tho  oosior  it  seems  for  thorn  to  dotermino 
tho  roquiromonts  and  altorations  noodod  by  tho  systom. 


8.20  Recommendations : 

All  of  tho  recommendations  prosontod  below  aro 
for  further  research  and  study.  Tho  recommendations 
aro  broken  into  throe  categories.  The  first  group  looks 
at  proposals  for  improving  or  enhancing  the  concept 
mapping  technique.  These  are  mostly  nice  to  have  ide'as. 
They  came  from  the  fact  that  current  concept  mapping 
is  a  lot  of  paper  and  pencil  work  that  is  tedious  and 
repetitive.  The  second  group  of  proposals  looks  at 
further  studies  that  would  apply  to  concept  mapping 
in  different  arenas.  The  third  and  final  group  of  proposal 
suggests  ways  that  the  PDP  could  be  enhanced,  used, 
and  evaluated  in  different  ways. 

8.21  Technique  Enhancements: 

There  are  three  areas  recommended  for  future  study 
that  could  improve  the  ability  of  analysts  to  perform 
the  concept  mapping  technique. 

8.211  Harness  the  power  of  Automation: 

Tools  such  as  the  Macintosh  with  MacDraw  need  to 
be  explored  as  aids  to  concept  mapping.  These  tools 
could  be  used  to  initially  build  the  maps  in  the  interview, 


store  the  maps,  make  quick  changes ,  formalize  a  map 
for  presentations ,  and  perform  'What-ifs'  with  the  links 
and  hierarchial  arrangements .  A  study  could  also  look 
at  the  peripherals  to  the  computer,  such  as:  larger 
screens ,  light  pens,  multiple  colors.  Software  enhancements 
could  include  a  study  on  the  value  of  animating  the 
concept  maps.  This  animation  would  be  the  evolution 

of  the  concept  map  as  it  was  constructed.  The  study 
would  explore  the  value  of  the  animation  in  transferring 
and  negotiating  meaning. 

Automating  the  maps  would  allow  the  maps  to  be 
'overlaid'.  This  would  mean  matching  key  concepts  from 
different  experts  and  physically  laying  one  map  over 
the  top  ol  the  other.  With  the  maps  stored  in  the  computer 
the  manipulation  of  concepts  would  be  trivial.  The 
differences  in  linkages  and  meanings  would  be  highlighted. 

The  areas  of  agreement  would  also  be  highlighted  and 
further  justify  the  evaluation  of  concepts  as  key  kernels 
in  the  problem. 

One  final  recommendation  for  follow-on  study  is 
to  build  a  portable  tutorial  program  to  teach  the  designers. 
This  tutorial  should  include  all  of  the  lessons  in  Appendices 
A  and  B  as  well  as  a  complete  walk-through  of  the  DSS 
development  with  hands  on  experience.  The  lesson  would 
be  targeted  for  the  user,  so  he  can  design  his  own  systems. 
Basically,  it  takes  the  middleman  out  of  the  DSS  develop- 


BMJlt . 


This  would  leave  tho  professional  DSS  designer 


the  time  for  consul tations  and  larger  projects. 

8.22  Concept  Mapping  Applications: 

There  are  f our  areas  of  study  that  could  be  continued 
based  on  the  application  of  concept  mapping  to  problem 
definition . 

8-221  Apply  to  more 

Concept  mapping  needs  to  be  applied  to  a  wider 
range  of  problems.  This  thesis  effort  concentrates 
on  the  problem  definition  for  DSS  development.  Concept 
mapping  can  be  applied  to  any  problem  domain  that  requires 
the  problem  solver  to  define  and  describe  the  problem. 
However.  procedures  need  to  be  established  and  experiments 
performed  to  prove  that  concept  mapping  can  be  applied 
to  any  problem  domain. 

8.222  Concept  Mapping  and  later  stages  of  DSS  Development: 

Purther  research  is  needed  in  the  later  stages 
of  DSS  prototype  development.  What  role  do  concept 
mapping,  storyboarding,  and  feature  charts  play  in  the 
maturing  development  stages  of  a  DSS?  Does  concept 
mapping  help  dampen  the  volatile  effects  of  major  changes 
in  system  requirements? 


There  art  two  areas  for  continued  research  in  RAAP. 
First,  the  full  set  of  concept  maps  need  to  be  reviewed 
again  by  the  experts  and  a  general  consensus  established. 
After  the  agreement  of  terms,  descriptions ,  definition 
and  process  elements,  a  list  of  kernels  needs  to  be 
developed.  This  list  of  kernels  can  then  be  evaluated 
and  ranked  in  order  of  importance,  feasibility,  etc. 
This  action  would  result  in  a  setting  of  research  goals 
and  justification  for  financial  and  political  support. 

The  second  emphasis  would  be  in  developing  a  briefing 
tool  out  of  the  combined  concept  map  of  the  problem 
definition.  This  map  would  become  a  finely  tuned 
communication  tool  for  use  by  the  Air  Staff  and  others. 
The  inherited  ability  of  concept  maps  to  present  informa¬ 
tion  in  an  easy-to-absorb  manner  would  make  the  presenta¬ 
tions  to  novices  much  more  understandable.  After  all, 
concept  mapping  is  an  educational  tool  for  negotiating 
meaning  and  transfer  understanding. 


8.224  Apply  CM  to  the  USAF  Acquisition  System: 

Further  research  is  needed  to  find  if  a  concept 
mapping  technique  is  feasible  in  building  a  management 
scheme.  Specifically,  can  concept  mapping  be  used  by 
the  Air  Force  Systems  Command  to  manage  adaptively  designed 
systems?  What  would  be  the  procedure?  What  evaluation 


criteria  would  be  ueed  to  compere  the  many  kernels  within 
a  system?  What  evaluation  criteria  would  be  used  to 
compare  similar  but  different  systems? 

0 . 23  PDP  Enhancements : 

Almost  the  exact  same  recommendations  for  enhancing 
the  concept  mapping  technique  can  be  said  for  the  enhancement 
of  the  PDP.  Automating  the  feature  chart  and  storyboard 
steps  would  also  aid  the  designer  in  the  process  of 
determining  the  system  requirements .  A  drawing  board, 
on  which  s/he  could  quickly  create  the  feature  charts 
and  storyboards,  modify,  rearrange  and  save  them,  would 

be  a  big  time  saver  as  well  as  a  big  boost  to  creativity. 

% 

Evaluation  criteria  on  the  human  engineering  aspects 
of  the  DSS  man-machine  interface  could  be  built  into 
the  drawing  board.  A  system  of  this  nature  could  alert 
the  designer  to  a  variety  of  faults  or  recommend  a  better 
idea.  The  system  might  offer  some  of  the  following 
information . 

1)  The  printing  is  too  small  to  read. 

2)  The  colors  are  too  difficult  to  distinguish 

3)  The  DSS  should  have  an  attention-getter. 

Example:  Flashing  light  -  red  in  color. 


8 . 30  Conclusions ; 

This  paper  haa  explored  a  broad  range  of  topics 
and  issues.  First,  the  decision  maker’s  environment 
was  described.  This  description  showed  the  world  as 
a  mass  of  fused  communications  bombarding  the  decision 
maker  constantly.  From  this  onslaught  of  information, 
he  must  identify  that  a  problem  exists  and  then  attempt 
to  define  it  in  full  detail  so  a  DSS ,  if  applicable, 
can  be  developed. 

Second,  the  theoretical  foundation  was  laid  for 
why  concept  mapping  would  work.  The  way  the  mind  stores 
information  and  the  way  concept  maps  capture  information 
was  shown  to  be  consistent.  Based  on  this  fact,  meaning 
and  understanding  would  be  represented  much  more  effectively 
than  with  any  other  method  of  capturing  knowledge. 

The  next  two  presentations  were  'how-to’s'.  The 
concept  mapping  tool  was  shown  with  two  self-paced  lessons 
and  helpful  hints  for  interviewing.  The  PDP  was  then 
introduced  and  explained  step  by  step.  All  of  these 
steps  and  lessons  were  designed  for  two  reasons.  The 
first  reason  was  to  establish  a  standard  approach  to 
the  problem  of  determining  the  system  requirements  for 
a  DSS  using  concept  mapping.  The  second  reason  was 
to  teach  the  reader  and  future  designer  a  successful 
way  of  designing  and  building  a  DSS. 

Finally,  the  paper  presented  eight  months  of  exercises 


where  concept  mapping  was  applied.  A  broad  variety 
of  problems  was  sought  out  and  experiments  were  run. 
The  successes ,  small  and  large,  were  all  recorded. 

Although  concept  mapping  is  a  simple  tool  to  use, 
it  is  powerful  in  its  ability  to  define  problems  and 
identify  kernels  in  a  problem  space.  Some  further  trials 
and  experimentation  with  the  method  of  applying  the 
tool  need  to  be  done.  But  the  theoretical  foundation 
and  its  current  success  points  to  a  new  approach  to 
understanding  problems. 
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APPENDIX  A: 

Introductory  Lesson  to  Concept  Mapping 


Prepared  by  Capt  H.R.  HcFarren 
flFIT/EH  GST-87J  Hay  1937 
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Decision  Support  System 


STORYBOARD  AND  EVALUATION 
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DECISION  SUPPORT  SYSTEM 

Submitted  To:  Lt.  Col.  Valusek 
By:  Capt  Bivins  and  Capt  McFarren 
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STORYBOARD  OF  A 
COMMAND  AND  CONTROL 
DSS 


Introduction 

This  paper  contains  the  storyboards  of  the  DSS  for  the  command  and  control  of 
theater  nuclear  weapons.  The  storyboards  are  meant  to  be  the  basic  displays  that  a  decision 
maker  would  see  in  a  theater  command  post  faced  with  the  decision  of  when  to  authorize 
the  release  of  theater  nuclear  weapons.  The  level  of  the  DM  that  this  storyboard  is  designed 
for  is  the  highest  level  in  the  theater  (CINGEUR  or  equivalent).  This  set  of  storyboards 
would  give  the  commander  the  "big"  picture  of  the  situation,  climate,  resources, 
constraints,  and  timing  required  to  make  the  decision  to  release  nuclear  weapons.  The 
storyboards  were  created  by  conducting  a  "problem  definition."  First  a  "concept  map"  was 
done  for  the  problem,  then  a  "task  analysis",  a  feature  chart,  the  storyboards,  and  Finally 
the  evaluation  of  the  DSS.  All  of  these  steps  lead  to  the  identification  of  kernels,  two  of 
which  were  identified  during  the  "concept  mapping"  and  are  highlighted  on  the  concept 
map.  The  next  few  pages  show  the  results  of  the  "concept  mapping”  and  "feature  chart." 
The  "problem  definition  process"  is  shown  below. 
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